Method of computing a hologram

ABSTRACT

A method of computing a hologram by determining the wavefronts at the approximate observer eye position that would be generated by a real version of an object to be reconstructed. In normal computer generated holograms, one determines the wavefronts needed to reconstruct an object; this is not done directly in the present invention. Instead, one determines the wavefronts at an observer window that would be generated by a real object located at the same position of the reconstructed object. One can then back-transforms these wavefronts to the hologram to determine how the hologram needs to be encoded to generate these wavefronts. A suitably encoded hologram can then generate a reconstruction of the three-dimensional scene that can be observed by placing one&#39;s eyes at the plane of the observer window and looking through the observer window.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.11/313,989, filed Dec. 21, 2005, which claims priority to GermanApplication No. DE 10 2004 063838, filed on Dec. 23, 2004, the entirecontents of each of which being fully incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The invention relates to a method of computing a hologram. Inparticular, it relates to a method of generating holograms usingelectro-holography. Electro-holography aims at realisingcomputer-generated holograms in real-time (i.e. a reconstructed objectcan be generated from encoded holographic data in a short space oftime). A holographic display typically contains an array of controllablepixels; the pixels reconstruct object points by electronically affectingthe amplitude and/or phase of an illuminating light. Such an array is aform of spatial light modulator (SLM). The display may not be arraybased, but instead be continuous. For example, it may be a continuousSLM, including a continuous SLM with matrix control or an AOM(acousto-optic modulator).

A suitable display device to reconstruct video holograms by spatialamplitude modulation of a light pattern is, for example, a LiquidCrystal Display (LCD). However, this invention can also be applied toother controllable devices, which use coherent light for modulating alight wave front.

2. Definition of Terms and Background Concepts

In this document, the term ‘pixel’ denotes a controllable hologram pixelin the SLM; a pixel is separately addressed and controlled by a discretevalue of a hologram point. Each pixel represents one hologram point ofthe video hologram. Hence, for a LCD, we use the term pixel tocorrespond to the individually addressable screen pixels. For a DLP, weuse the term pixel to correspond to an individual micro-mirror, or asmall group of micro-mirrors. On a continuous SLM, a pixel is atransient region on the SLM that represents one complex hologram point.The term pixel therefore means, at its most general, the smallest unitthat can represent (e.g. display) one complex hologram point. To achievecolour encoding, each pixel may comprise sub-pixels for representing ordisplaying the colour hologram points in each of the three primarycolours. Depending on the kind of video hologram encoding, furthersub-pixels may be used for encoding or representing the primary coloursof each colour hologram point. For instance, if Burckhardt encoding isused for a colour hologram, each pixel needs an arrangement of ninesub-pixels. For better clarity in this document each pixel is encoded byonly one discrete hologram point value, containing an amplitudecomponent and a phase component; said components may be zero. Adedicated controller or driver controls the sub-pixels using separatecontrol signals for each sub-pixel. The controller or driver and theprovision of control signals is not however the subject of thisinvention.

The term ‘pitch’ describes in this document the distance between thecentres of two adjacent pixels of a SLM. It thus characterizes thedisplay resolution.

An ‘observer window’ is a limited virtual zone through which theobserver can see the entire reconstructed 3D scene with sufficientlyhigh visibility. The observer window is located at or near the eyes ofthe observer. The observer window can be moved in the X, Y, and Zdirections. Within the observer window, the wave fields interfere in away that leads to the reconstructed object being visible to theobserver. In one implementation of this invention, the scene is viewablethrough the observer window and is reconstructed inside a frustum thatstretches between the edges of the observer window and the SLM. It ispossible to include two observer windows, one for each eye. Moresophisticated observer window arrangements are also possible. It is alsopossible to encode video holograms containing objects or entire scenesthat the observer can see behind the SLM.

The term ‘encoding’ describes the way in which the SLM is supplied withcontrol signals so that coherent light passing through the SLM or thatis reflected by the SLM, reconstructs a three-dimensional scene.

A ‘light source’ according to this document is considered sufficientlycoherent if the light is spatially coherent to an extent allowinginterference, so that it allows holographic reconstruction with anadequate resolution in at least one dimension. Spatial coherence relatesto the lateral extent of the light source. Conventional light sources,like LEDs or Cold Cathode Fluorescent Lamps, can also meet theserequirements if they radiate light through an adequately narrowaperture. Light from a laser source can be regarded as emanating from apoint source within diffraction limits. It leads to a sharpreconstruction of the object, i.e. each object point is reconstructed asa point within diffraction limits.

Light from a spatially incoherent source is laterally extended andcauses a blurring or smearing of the reconstructed object. The degree ofblurring or smearing is given by the broadened size of an object pointreconstructed at a given position. In order to use a spatiallyincoherent source for hologram construction, a trade-off has to be foundbetween reconstruction quality and brightness by adjusting the aperturewidth. A smaller aperture results in improved spatial coherence andhence lowers the degree of blurring or smearing. But a smaller apertureresults in a lower brightness. The term ‘partial spatial coherence’ isused to describe such a light source.

Temporal coherence relates to the spectral line width of the lightsource. In order to ensure temporal coherence, the light must have anadequately narrow wavelength range. The spectral bandwidth ofhigh-brightness LEDs is sufficiently narrow to ensure temporal coherencefor holographic reconstruction. The diffraction angle at the SLM isproportional to the wavelength, which means that only a monochromaticsource will lead to a sharp reconstruction of an object point. Abroadened spectrum will lead to broadened object points and smeared orblurred object reconstructions. The spectrum of a laser source can beregarded as monochromatic. The spectral line width of a LED issufficiently narrow to facilitate good reconstructions.

In most holographic systems, the encoded hologram is the transform ofthe 3D scene to be reconstructed. The term ‘transform’ should beexpansively construed to include any mathematical or computationaltechnique that is equivalent to or approximates to a transform.Transforms in the mathematical sense are merely approximations tophysical processes more accurately described by Maxwellian wavepropagation equations. Transforms such as Fresnel transforms (or thespecial class of transforms known as Fourier transforms) are secondorder approximations, but have advantages; because they are basicallyalgebraic as opposed to differential, they can be handled in acomputationally efficient manner, also, they can be accuratelyimplemented in optical systems.

3. Description of Related Art

A drawback of 3D-autostereoscopic displays using conventional optics isa mismatch between parallax information and accommodation of the lens ofthe eye. On the one hand, the observer's eyes see different perspectiveviews of a 3D-scene, which simulate a depth impression of objects atarbitrary distance. On the other hand, each perspective view is locatedon the display surface itself. Hence, the eye focuses on the displaysurface, and each eye sees a flat image. That causes a mismatch betweenseeing objects at arbitrary depth achieved by parallax information andthe accommodation of the eyes to a fixed display surface. The mismatchmay cause an unpleasant feeling and eye fatigue.

Known electro-holographic displays, for instance as described indocument WO 01/95016, use a hologram matrix supplied with a pixelpattern of controllable openings which reconstructs objects of a 3Dscene at correct depths. This can avoid the inconvenience ofconventional stereoscopic displays. The diffraction from the smallopenings is used to reconstruct the 3D-scene. The wave fronts emergingfrom the openings converge in object points of the scene before theyreach the observer. The smaller the diameter of openings of thishologram matrix, and thus the pitch, the larger is the diffractionangle. That causes a wide viewing angle for the use by the observer.Consequently, enlarging the viewing angle requires improved resolution.

The document from N. Fukaya, K. Maeno, K. Sato and T. Honda;“Eye-position tracking type electro-holographic display using liquidcrystal devices”, S36-5, Post-Deadline Paper Asia Display '95 describesa method to expand the viewing zone in an electro-holographic display byeye position tracking. The document suggests that it is not necessary toproject light from a holographic array into the whole area where theobserver might be located. Rather, it is sufficient to restrict theilluminated area to the observer's eyes. Therefore, a large hologramarray is divided into small pieces of separate holograms, each encodedwith a pair of small holograms, instead of a single large hologram. Thatcauses an observer to see the same 3-D object as if from one largehologram; each reconstructs the object and its viewing zone correspondswith each eye position. If the observer moves to another position, theobserver gets the reconstruction and viewing zone from another pair ofsmall holograms. This restriction facilitates the use of SLMs withsignificantly lower pixel count.

For tracking the observer's lateral (X,Y) movement, a controllablescanning mirror projects the light of the SLM to the observer's eyes.The tracking of observer's longitudinal (Z) movement occurs by changingthe relative space between the small LCDs.

The document mentions a width of the reconstruction of 50 mm, whichresults in a relatively small angle in which the 3D-scene is rendered.

A disadvantage of this method is that manufacturing a holographic arraycontaining multiple separate small LCDs is very difficult. Further, ithas to be avoided that multiple reconstructions of the same object pointof a 3D-scene can be seen. That limits the size of the SLM and hence thesize of the object.

In order to reduce the enormous number of computations the patentspecification WO 01/95016 A1 discloses a hologram calculation of onlysuch parts of an electro hologram that can be seen directly by anobserver or such parts that change. The electro hologram array consistsof addressable sub-regions. The calculation is founded on a so-calledeffective exit pupil, which can coincide with the eye pupil of theobserver in a specific position. If the observer position changes, atracking device re-calculates the hologram part that generates the imagefor the new observer position.

However, this partly nullifies the reduction in the number ofcomputations and the described solution does not avoid the disadvantageto need a large controllable SLM with extremely small pitch.

A device described in Document WO 2003/021363 (A1) for reconstructingcomputer-generated holograms decreases the requirements on the SLM byrestricting the reconstruction to a horizontal-parallax only (HPO)hologram.

The illumination means is a line light source which generatesmonochromatic light with a bandwidth of less than 10 m and which iscoherent in the horizontal direction but incoherent in the verticaldirection. The holographic reconstruction takes place only in thehorizontal direction, whereas there is no holographic reconstruction inthe vertical direction. This results in a reconstructed object withhorizontal motion parallax. The perspective view does not change uponvertical motion. A HPO hologram requires less resolution of the SLM inthe vertical direction than a full-parallax hologram. There is only aperiodicity in the reconstruction direction, i.e. horizontally. Thecomputational load is decreased for one-dimensional line holograms.

The document U.S. Pat. No. 6,927,886 (Plesniak) relates to computedholographic stereograms having a reconfigurable image surface that isspatially distinct from the hologram surface on which the holographicstereogram is encoded. A three-dimensional object or scene is capturedor synthesized as a stack of one-dimensional holographic views(HPO-holograms) reconstructed by an array containing so-calledholopixels having a structure different from a known pixel structure.Hardware generates computed diffractive patterns to produce viewableimages and a generating module reconstructs the holographic stereogramsby interference patterns at one or more image surfaces that arespatially distinct from the hologram surface.

The device projects one or more series of parallax views of athree-dimensional scene through one or more holographicallyreconstructed image planes. Via software, the image plane can bespecified at any location off of the hologram plane and populated by avariable number of projector-pixels. Further, in a specific embodiment,the hologram surface and the image surface are separated by anadjustable distance. The image surface may be a variable depth and/orresolution.

In contrast to the pixels of the above-mentioned SLMs the holopixelshave a very complicated structure and can reconstruct severalholographic views.

Due to a reduction in the observer window to an extension that is justslightly larger than the pupil of an eye, applicant's former patentapplication WO 2004/044659 reduces significantly the requirements on thepitch of the SLM and the computational load of the holographic array.The device contains at least one light source, which providessufficiently coherent light, a Fourier-transform lens, and a holographicarray with a matrix of pixels that each contain one or more openings.The phase or amplitude of each opening is controllable and an observerplane is located in the image plane of the light source. In the observerplane, at least one observer window is formed in a periodicity intervalas a transform of the video hologram, the observer window allowing anobserver to observe a reconstruction of a three-dimensional scene. Themaximal extent (i.e. X, Y dimensions) of the observer window maycorrespond to the periodicity interval in the Fourier transformationplane (which is equivalent to the image plane of the light source). Areconstruction frustum stretches between the display area and theobserver window, said frustum containing the entire three-dimensionalscene of the video hologram. As noted above, the observer window islimited to and positioned in relation to observer's eyes. Appendix IIlists further aspects of and enhancements of WO 2004/044659; theenhancements are within the scope of the present invention.

4. Technical Background of the Invention

Common holographic arrays reconstruct a light wavefront of 3D-objects or3D-scenes by coherent superposition of light waves. For that purpose, aspatial light modulator (SLM) displays a wave pattern encoded on the SLM(which may be a holographic array). The encoded hologram is thetransform of the 3D scene. The SLM diffracts the light waves provided bya backlight and reconstructs the scene.

Fundamentally, the displaying of electro holograms, in which theholograms are sampled in hologram points, leads to a problem. Sampledholograms always have the property of periodic repetitions of theencoded wave pattern in periodicity intervals in the observer plane.These repetitions will cause multiple reconstructions of the same objector object points.

If the dimension of the reconstruction of the hologram exceeds theperiodicity interval, adjacent diffraction orders will overlap. As theresolution is gradually decreased, i.e. as the pitch rises, the edges ofthe reconstruction will be distorted increasingly by overlappingadjacent diffraction orders. The usable extent of the reconstruction isthus gradually limited, because an overlapping of periodicalreconstructed observer windows has to be avoided.

The viewing zone of a SLM depends on its maximum diffraction angle. Themaximum is defined by the pixel pitch of the SLM.

As is generally known, in Fourier holograms the scene is reconstructedin a reconstruction plane as a direct or inverse Fourier transform ofthe encoding of the pixels of the holographic array (i.e. objectreconstruction is at the Fourier plane of the array). Thisreconstruction is continued periodically at a periodicity interval, theextent of said periodicity interval being inversely proportional to thepixel pitch in the holographic array.

If larger periodicity intervals and thus greater viewing angles are tobe achieved, the required pitch (and so the extent of sub-pixels of eachpixel in the holographic array) comes closer to the wavelength of theilluminating light. The array area must be sufficiently large in orderto be able to reconstruct large scenes. These two conditions (smallpitch and large area) require a large holographic array having a greatnumber of pixels.

For rendering the reconstructions of electro holograms, a sufficientlylarge viewing zone must be provided. In conventional holographic arrays,the viewing zone has to cover at least the eye separation, whichrequires a pixel pitch of ca. 10 μm at most. Costly hardware and highcomputational speeds are needed to calculate the electro-hologram inreal-time.

The computational load on equipment that generates holograms in realtime depends on the complexity of the holograms. A full-parallaxhologram reconstructs an object holographically by coherentsuperposition of waves in the horizontal and vertical directions. Givena sufficiently large observer window or observer region, thereconstructed object can be seen with motion parallax in the horizontaland vertical directions, like a real object. However, a large observerregion requires a high resolution SLM in both horizontal and verticaldirections.

The requirements on the SLM and the computational device (e.g. dedicatedASIC, main device CPU, separate stand-alone device etc.) can be reducedby restriction to a horizontal-parallax only (HPO) hologram or avertical-parallax only (VPO) hologram

If a horizontal-parallax only hologram is used, the holographicreconstruction takes place only in the horizontal direction and there isno holographic reconstruction in the vertical direction. This results ina reconstructed object with horizontal motion parallax. The perspectiveview does not change upon vertical motion. A HPO hologram requires lessresolution of the SLM in vertical direction than a full-parallaxhologram. There is only a periodicity in the reconstruction direction,i.e. horizontally. The computational load is therefore decreased forone-dimensional line holograms.

A vertical-parallax only hologram where the reconstruction takes placeonly in the vertical direction is also possible but uncommon. Thisresults in a reconstructed object with vertical motion parallax. Thereis no motion parallax in the horizontal direction. The differentperspective views for the left eye and right eye have to be createdseparately. This can be done by temporal or spatial multiplexing of theobserver windows.

Both VPO holograms and HPO holograms accomplish eye focussing (i.e.adapting the eye lens curvature) at the object distance.

It is common practice that the observer window of conventionalelectro-holographic displays is much larger than the pupil of the eye(i.e. that the reconstructed object can be seen correctly over a largearea). A consequence is that much effort is needed to project light intoregions of the space where no observer is located. Therefore, theperformance required for the whole electro-holographic displays tocontrol the optical wave front is extremely high.

Given a sufficiently large observer window or observer region, thereconstructed object facilitates motion parallax in horizontal andvertical direction, like a real object. However, a large observer regionrequires high resolution in both horizontal and vertical direction ofthe holographic array.

One known method to encode a hologram is by using a conventional liquidcrystal display that modulates the amplitude by known Burckhardtencoding which is based on the detour-phase effect. The encoding needsthree neighbouring sub-pixels per pixel and primary colour. Thisencoding provides three categories of diffraction orders called—1^(st),0^(th), 1^(st), 2^(nd), 3^(rd), etc. diffraction order. The firstcategory, the 0^(th), 3^(rd), etc. diffraction order containun-diffracted light. These orders do not provide any reconstruction. Thesecond category, the −1^(st), 4^(th) etc. diffraction order contains thereconstruction of the encoded object. In contrast, the third category,the −1^(st), 2^(nd), etc. diffraction order contains the reconstructionof a depth-inverted object. That means this reconstruction is incorrect.A correct reconstruction contains the 1^(st), 4^(th), etc. diffractionorders only. Due to the finite aperture of the LCD openings, theintensity of the diffraction pattern falls off towards higherdiffraction orders. Therefore, it is advantageous to locate the observerwindow in the 1^(St) diffraction order.

A periodicity interval provided by Burckhardt encoding comprises a groupof three adjacent diffraction orders, like the 1^(St), 0^(th) and −1^(st) diffraction order. The size of each periodicity interval is givenby P_(diffr)=λ*d/p, where λ defines the wavelength of the illuminationlight; d is the distance between hologram and observer plane, p is thesub-pixel pitch.

As the object is reconstructed correctly in the 1^(St) diffraction orderonly, the observer window can cover ⅓ of the periodicity intervalP_(diffr) only. Because the size of the periodicity interval depends onthe wavelength of the illumination light too, for colour holograms thesize of the observer window is limited by the shortest wavelength of theprimary colour that is used.

If a phase-modulating SLM is used in a Fourier hologram, the periodicityinterval contains no depth-inverted reconstruction of an object.However, there is also un-diffracted light. Therefore, not the wholeperiodicity interval can be used as an observer window. Theun-diffracted light has to be excluded from the observer window also.

If a complex-modulating SLM is used, each single pixel can be used toencode one complex value. Therefore, each periodicity interval in theobserver plane contains only one diffraction order. Hence, the wholeperiodicity interval can be used for an observer window.

In general, the observer window has to be located within one periodicityinterval; however, depending on the encoding method of thecomplex-valued hologram on the SLM the observer window has to be smallerthan a periodicity interval.

The propagation of light caused by an electro-hologram can be describedby Fresnel transforms or Fourier transforms. Fresnel transforms describethe near-field light distribution whereas Fourier transforms describethe far-field light distribution at infinite distance. The far-fieldlight distribution can be shifted to a finite distance by a focussinglens.

The solution known from patent application WO 2004/044659 is based onthe idea to limit this encoded area such that light emanating fromreconstructed scene points is confined to one observer window.Therefore, the device reconstructs a video hologram in one periodicityinterval of the Fourier transform in an observer plane. Thereconstructed three-dimensional scene can be observed through anobserver window located in front of each eye. The reconstructed scene isvisible inside the reconstruction frustum; the scene can thereby bereconstructed on, in front of or behind the array surface. This allowsthe use of a conventional array with resolution near 3 million pixels atreasonable hardware expenses and computing power.

SUMMARY OF THE INVENTION

It is an object of this invention to reduce the computationalrequirements of computing a hologram. It is a further object to realizean electro-holographic display for reconstructing video holograms usinga SLM with a conventional resolution; the holograms should provide ahigh quality reconstructed image.

In order to achieve this object, an invention as defined in the appendedclaims is provided. The invention is a method of computing a hologram bydetermining the wavefronts at the approximate observer eye position thatwould be generated by a real version of an object to be reconstructed.In normal computer generated holograms, one determines the wavefrontsneeded to reconstruct every point in an object. This can be verycomputationally intensive. This is not done directly in the presentinvention. Instead, with the present invention, one may determine thewavefronts at an observer window that would be generated by a realobject located at the same position of the reconstructed object. One canthen back-transform these wavefronts to the hologram to determine howthe hologram needs to be encoded to generate these wavefronts.

Although apparently more complex than the conventional approach ofdirectly working out how the hologram needs to be encoded to generateeach point of a reconstructed object, the present invention does enablecomputational approaches that are very efficient. For example, one canapply a Fresnel transform for all of the reconstructed object points tothe observer window; one can then add together the wavefronts at theobserver window and then apply a single Fourier transform back to thehologram plane itself to define the hologram points on the hologram thatare needed to reconstruct the object. Further, this approach leads to asmall observer window if low-resolution SLMs are used. The smallobserver window does not however matter if it is larger than the eyepupil and if the eye pupil is properly tracked.

This computational method can take place when holographic data is beingprocessed at a user's display device (e.g. an ASIC in the displaydevice) or in a computational unit connected to the display device.Hence the display device (or connected computational unit) receivesholographic data (e.g. on an optical recoding medium, or over a highbandwidth network etc.) that can be processed locally by the display orcomputational unit. This typically requires some way of tracking theobserver's eyes (or the eyes of several observers) in real time so thatthe hologram can be computed in real time from the holographic data;this real time computed hologram is then illuminated using an opticalsystem in such a way that an object is holographically reconstructed.The holographic data will, in the case of a video hologram, be changingover time; it is regularly and rapidly processed many times a second ina way that is a function of the positions of the observer(s)' eyes.

A suitably encoded hologram can then generate a reconstruction of thethree-dimensional scene that can be observed by placing one's eyes atthe plane of the observer window and looking through the observerwindow.

The present invention preferably uses a device described in applicant'sformer patent application WO 2004/044659 where sufficiently coherentlight, imaged by optical focusing means, passes through controllablepixels of a single holographic array (or other form of SLM) into atleast one observer window, each being located in one periodicityinterval of an observer plane (known also as a reference layer) near theeyes of an observer. This reconstructs a scene that has beenholographically encoded by the controllable pixels and thus renders itvisible through the observer window. A frustum stretches between theholographic array and the observer window. In contrast to common knowndevices, the frustum contains a reconstruction of the entirethree-dimensional scene encoded on the holographic array.

The extent of the observer window (i.e. in the x and y directions) is nolarger than the periodicity interval in the layer or plane whichcontains the image of the light source used for reconstruction. Thisleads to the effect that the video hologram according to thisimplementation needs smaller diffraction angles compared with othersolutions, all the more if the data sets for the reference layer and forthe hologram layer have the same number of matrix point values. Thanksto the computation of amplitude values for the light modulator matrix,the demands on processing speed are greatly reduced. In particular inconjunction with a known position detection and tracking device fortracking the current observer position, the dimension of the observerwindow can be greatly minimised to benefit from this advantage. Annex Iincludes more details of this implementation.

In the present invention, the light from the light source is focussed tothe observer plane located near to observer's eyes. Therefore, in theobserver plane there is the Fourier transform of the hologram: theobserver window is hence also the Fourier transform of the hologram. Thereconstructed object is not the Fourier transform of the hologram butthe Fresnel transform, as the reconstructed object is not in the focusplane of the lens. The reconstructed object, i.e. the Fresnel transformof the hologram, is located in the frustum defined by hologram and theobserver window.

The occurrence of multiple object reconstructions can be avoided bylimiting the hologram region on which the scene information is encodedon the holographic array for each sample point of the holographicreconstruction. By encoding the video hologram on a restricted region ofthe holographic array, the reconstruction of the observer windows has tobe limited to an extent and a location arranged inside of thatdiffraction order of one periodicity interval that can show the correctand complete reconstruction of the encoded holographic scene.

The observer window has to be located within one periodicity intervalonly, however depending on the encoding method used, the observer windowhas to be smaller than the periodicity interval. For instance, ifBurckhardt encoding is used, this can be a one-third part of theperiodicity interval defined by the shortest wavelength of the primarycolour used. The selection of the resolution of the electro-holographicdisplay and its encoding restricts the size of the observer windows inrelation to an eye size of an observer and positions the windows to theeye positions by known eye tracking means.

The invention is not limited to encoding Fourier holograms. However,there is an advantage of Fourier holograms compared to Fresnelholograms. As no hologram has 100% efficiency, there will always beundiffracted light. In a Fourier hologram, undiffracted light isfocussed to a spot in the observer plane. If this spot is outside theobserver window the undiffracted light is not visible and hence does notdisturb. In a Fresnel hologram, the undiffracted light is not focussedand is therefore visible as a disturbing background.

An implementation of the invention provides a computer generatedhologram comprising regions that encode digitalized encoding informationneeded to reconstruct a holographic image that is visible from a definedobserver position. The encoding information of each single object pointin the reconstructed scene is encoded solely in a restricted region ofthe SLM. Each encoded restricted region can carry encoding informationfrom other adjacent object points, so that the regions of differentother adjacent object points overlap each other. For each object point,the region with encoded information is restricted in size to form asmall portion of the entire video hologram, the size being such thatmultiple reconstructions of that point caused by higher diffractionorders are not visible at the defined observer position.

In conventional electro-holographic displays the hologram is calculatedas the Fourier Fresnel transform of the objects. This leads to a smallobject size if low-resolution SLMs are used.

In contrast, according to an implementation of the invention, thehologram is calculated as the Fourier transform of the observer window.This leads to a small observer window if low-resolution SLMs are used,but the reconstructed three-dimensional scene can extend to the entirespace of the frustum. Implementations of the present invention includealso the concepts and features defined in Annex III.

The invention can be implemented as:

-   -   a data carrier programmed with holographic data, when used in        combination with a device that can compute a hologram from that        data using the methods disclosed herein.    -   a data distribution network when carrying holographic data that        can be processed by a device to compute a hologram using the        methods disclosed herein.    -   a computing device adapted to compute data defining a video        hologram using the methods disclosed herein.    -   a display screen when displaying a hologram computed by the        methods disclosed herein.    -   a holographic reconstruction from a hologram computed by the        methods disclosed herein.

Other implementation features include the hologram being encoded onto adisplay in a television, a multimedia device, a gaming device, a medicalimage display device, a military information display device. The displaycan be a TFT flat screen SLM.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a top view of a general illustration of a device forreconstructing video holograms, showing the generation and arrangementof the diffraction orders when the Burckhardt encoding is used;

FIG. 2 is a general illustration of a device in top view forreconstructing video holograms, showing the encoding of a single objectpoint of a three-dimensional scene which can be viewed through aobserver window;

FIG. 3 is a general illustration of a device for reconstructing videoholograms, showing several object points of encoding thethree-dimensional scene in a part of the video hologram.

FIG. 4 shows the same device as in FIG. 3, but having a higherresolution

Further aspects of an embodiment with regard to a video hologram and adevice for reconstructing video holograms are illustrated and explainedin Annex II in conjunction with the accompanying drawings, wherein

FIG. 5A is a general illustration of a video hologram and a device forreconstructing video holograms showing the generation of the diffractionorders and the position of a viewing window;

FIG. 5B is a general illustration of a device for reconstructing videoholograms showing a three-dimensional scene which can be viewed througha viewing window;

FIG. 5C is a general illustration of a device for reconstructing videoholograms showing the encoding of the three-dimensional scene in a partof the video hologram;

FIG. 5D is a diagram showing the light intensity distribution in theviewing plane depending on the diffraction orders; and

FIG. 5E is a general illustration of a device for reconstructing videoholograms showing the position of the viewing windows for both eyes of aviewer with regard to the diffraction orders to prevent cross-talking.

DETAILED DESCRIPTION OF THE INVENTION

A device for reconstructing video holograms comprises a SLM (which inthis example is a holographic array HA), a sufficiently coherent lightsource LS and an optical focussing system F. The light source can berealized by virtual illumination means, e.g. a LED array or a lineshaped backlight locally controlled and directed by controllable shuttermeans to form an array of point or line light sources. The holographicarray itself consists of pixels which are arranged in a regular pattern;each pixel contains a number of illuminated and transmissive openings(sub-pixels). The openings of each sub-pixel are separately addressableand controllable in phase and/or amplitude to influence the passingillumination light to be encoded via holographic complex valued numbersrepresenting the sequence of a video hologram.

In the observer plane OP at least one observer window OW is formed in aperiodicity interval as a direct or inverse Fourier transform of thevideo hologram. The observer window OW allows an observer eye OE to viewa reconstruction 3D-S of a three-dimensional scene. The maximal extentof the observer window OW corresponds to the periodicity interval in theobserver plane OP of the Fourier back transformation, which is identicalwith the image plane of the light source LS.

In the preferred embodiment of the invention, information about athree-dimensional scene is encoded in a transmissive SLM, HA. Theilluminated pixel-arrangements contain several openings (sub-pixels fora colour display). Spatial control of the amplitude and phase of theilluminating light is achieved by the encoded pixel pattern. However,the basic idea of the invention is not limited to the described SLM.Both transflective and reflective arrays or arrays that directlymodulate the phase of the light waves, such as Freedericksz pixels, maybe used.

FIG. 1

FIG. 1 shows a light source LS that illuminates via focusing means F aSLM, the array HA. In the best mode embodiment of the invention, a lineshaped light source forms the light source LS and the focusing means Fis a vertically disposed cylindrical lens that images the coherent lightof light source LS into an observer plane OP.

FIG. 1 shows a device that uses the known Burckhardt encoding. Theobserver plane OP corresponds with the Fourier plane of the backtransform of the video hologram with diffraction orders.

The light source LS is imaged in the observer plane OP through thefocusing means F, representing a Fourier transform lens. The SLM, HA,encoded with a video hologram, reconstructs the hologram in the observerplane OP as a Fourier back transform. The periodic openings of the SLMHA create equidistantly staggered diffraction orders in the observerplane OP, where the holographic encoding into higher diffraction orderstakes place, e.g. by way of the so-called detour phase effect. Becausethe light intensity decreases towards higher diffraction orders, the1^(st) or 1^(st) diffraction order is used as the observer window OWshown in FIG. 2. The dimension of the reconstruction was chosen here tocorrespond with the dimension of the periodicity interval of the1.sup.st diffraction order in the observer plane OP. Consequently,higher diffraction orders are positioned together without forming a gap,but also without overlapping.

FIG. 2

As shown in FIG. 2, the selected 1^(st) diffraction order at theobserver plane OP is the reconstruction of the video hologram. It is notthe reconstruction of the object itself, but instead is the wavefront atthe observer window OW that would be generated by a real object locatedat the same position as the reconstructed object. Hence, that videohologram reconstruction (i.e. not the object reconstruction) does notrepresent the actual three-dimensional scene 3D-S. It is only used asthe observer window OW through which a reconstruction of thethree-dimensional scene 3D-S can be observed. The scene is locatedinside a reconstruction frustum RF which stretches between the SLM andthe observer window OW. The scene 3D-S is rendered as the Fresneltransform of the video hologram, whereas the observer window OW is apart of the Fourier transform. FIG. 2 shows a holographic encoding ofthe SLM HA by a single object point P of the 3D-scene. In a conventionalholographic reconstruction, the 1.sup.st diffraction order would itselfconstitute the reconstruction of the object. The reconstructed objectwould be at the Fourier plane. In the FIG. 2 implementation, theobserver plane co-incides with the Fourier plane.

FIG. 2 shows the corresponding holographic encoding. Thethree-dimensional scene is composed of discrete points, e.g. the pointsP1 to P3 (see FIG. 3). The pyramid PY with the observer window OW beingthe base and the selected point P in the scene 3D-S being the peak, isprolonged through this point and projected on to the SLM HA. Aprojection region A1 is created in the video hologram, that point beingholographically encoded solely in the projection region A1. Thedistances between the point P to the pixels of the hologram can bedetermined in order to calculate the phase values. This reconstruction3D-S is larger than the observer window.

The size of the observer window OW is constrained by the periodicityinterval. In conventional holographic reconstructions, the periodicityinterval constrains the size of the reconstructed object; that does notapply to the present implementation. As a consequence, thisimplementation allows much larger reconstructed objects to be generatedthan would be possible using a conventional holographic approach with adisplay having the same pixel pitch. A reconstructed object can appearanywhere inside reconstruction frustrum RF.

If the point P was encoded in the entire hologram, the reconstructionwould extend beyond the periodicity interval. The viewing zones fromadjacent diffraction orders would overlap, which would result in theviewer seeing a periodic continuation of the object point P. Thecontours of a thus encoded surface would appear blurted due to multipleoverlapping.

FIG. 3

FIG. 3 shows an encoding of a three-dimensional scene 3D-S, having theobject points P1 to P3. As shown each object point P1 to P3 is solelyencoded in a corresponding restricted encoding region of the SLM HAonly. These regions are defined by the reference numbers A1 to A3. Theposition of the object points P1 and P2 differ in depth information.Therefore, on the SLM both encoding regions A1 and A2 do overlap.

FIG. 4

FIG. 4 shows the FIG. 3 situation in greater detail.

The light source LS is imaged to the observer plane OP. The lens F or alens array images light source LS. Compared to a Fresnel hologram, theFourier hologram has the advantage that undiffracted light is focused tosmall spots in the observer plane OP. If these spots are outside theobserver window, the undiffracted light is not visible as disturbingbackground.

In the case of a coherent light source, the size of the imaged lightsource is limited by diffraction and aberrations at the lens and isusually very small compared to the resolution of the human eye. If aspatially incoherent source, like a LED or a LED array is used, the sizeof the imaged light source is also determined by the aperture of thelight source and the magnification of the lens.

In a preferred embodiment of the invention, an array of light sourcesand an array of lenses is used, the images of all light sources have tocoincide. This means that the pitch of the light source array has to beslightly larger than the pitch of the lens array, according to a simplegeometrical construction. If the sources and lenses are properlyaligned, a diffraction pattern is visible in the observer plane OP whichlooks like the diffraction pattern as if a single source and a singlelens was used.

There may be additional optical elements which shape the lightdistribution in order to homogenize the light distribution or increasethe intensity in the observer plane. These may be diffuser sheets orlenses.

For a pure holographic setup, tracking of the observer is achieved byshifting the light source(s) relative to the lens (array). This may bedone by mechanically shifting the source(s) or the lens (array) or byelectronically shifting the apertures on the shutter LCD panel. Trackingmight also be done by a configurable diffractive optical element or ascanning mirror.

If holographic object reconstruction in the vertical direction andautostereoscopic image separation in the horizontal direction arecombined, tracking in the horizontal direction can also be done byhorizontal shifting of the VPO hologram on the SLM.

The following annexes are appended:

Annex I: A detailed description of another embodiment of the presentinvention

Annex II: Theoretical background; detail and enhancements to thepreferred embodiments.

Annex III: A summary of key concepts from, and enhancements to, WO2004/044659, the contents of which are incorporated by reference.

ANNEX I

Further Embodiment with Regard to a Method and Device for ComputingComputer-Generated Video Holograms

ANNEX I Background of the Embodiment

The present embodiment relates to a method and device for computingcomputer-generated holograms (CGH), especially real-time or nearreal-time holograms, e.g. video holograms, which are made up ofindividually controllable hologram cells; each cell displayscomplex-valued data. Besides stills, real-time video holograms are ofparticular interest. Electro-holography aims at a realization of CGH inreal-time. The electro-hologram display is effectively a Spatial LightModulator (SLM) with controllable pixels reconstructing object points byspatial modulating an illuminating light. Throughout this specification,we will refer to real-time holograms as video holograms. For thoseskilled in the art, video holograms also cover Optically AddressableSLMs, Acousto-Optic light Modulators (AOM) or the like which do notexhibit separately arranged cells.

In contrast to classic holograms, which are stored photographically orin another suitable way in the form of interference patterns, videoholograms exist as a result of a computation of discrete hologram datafrom sequences of a three-dimensional scene. During the computationprocess, the intermediate data is stored, for example, by electronicmeans, such as an electronic storage medium of a computer, graphicsprocessor, graphics adapter or other hardware component. The 3D scenedata can be generated in any way, e.g. by interference patterns or 3Dconversion of 2D data.

ANNEX I Background Concepts

Spatial Light Modulators (SLMs) are devices for spatially controllingthe complex-valued data, i.e. the magnitude and phase of the amplitudeof each colour component of light. The colour can be encoded by beingspatially or temporally multiplexed. The SLM may contain controllablehologram cells, each being separately addressed and controlled by adiscrete value set of hologram data. SLMs can also be continuous and notcontain discrete cells. To achieve colour encoding by spatialmultiplexing in a cell based SLM, each pixel in a cell may comprisecolour sub-pixels, each sub-pixel displaying one of three or moreprimary colours. Depending on the kind of video hologram encoding used,further sub-pixels may be used for encoding each of the primary colours.For instance, a detour phase encoding, like the known Burckhardtencoding, needs an arrangement of three sub-pixels for each colourcomponent. Taking into account three colour components, the number ofsub pixels totals to nine for a hologram cell (i.e. there are threeprimary colours; there are three sub-pixels for each of these threeprimary colours, making nine sub-pixels in total. In contrast, the alsoknown Lee encoding requires four sub pixels; and a two-phase encodingrequires two sub pixels for each colour in a hologram cell.

Each hologram cell is encoded by one discrete set of hologram datacontaining at least amplitude and phase information of a given colourcomponent; said data may be zero or have a standard value or may bearbitrarily chosen. The hologram data of a video hologram iscontinuously updated according to the scheme driving the SLM. Since theentire hologram is made up of thousands of cells, there are thousands ofdiscrete sets of hologram data.

A hologram data set contains all the information necessary to encode onesingle video hologram cell as part of a time sequence to reconstruct athree-dimensional scene.

A dedicated driver uses the discrete hologram data sets to provide thespecific control signals for controlling the corresponding sub-pixels ofthe SLM. The driver and the provision of control signals are specific tothe type of the SLM used and is not the subject of this embodiment. Manykinds of SLMs, like transmissive or reflective liquid crystal displays,micro optical and electro mechanical micro systems or continuouslyoptically addressed SLMs and acousto optic modulators can be used incombination with this embodiment.

The modulated light emerges from the hologram with the amplitude andphase appropriately controlled and propagates through the freespace-towards the observer in the form of a light wave front, toreconstruct a three-dimensional scene. Encoding the SLM with thehologram data set causes the wave field emitted from the display toreconstruct the three-dimensional scene as desired by creatinginterferences in the viewing space.

The present embodiment provides real-time or near real-time control datafor each hologram cell for the required wave modulation by computingamplitude and/or phase for a given wavelength.

ANNEX I Summary of the Embodiment

The following indices refer to FIGS. 5A-5E.

The object of this embodiment is to provide a method for speeding upcomputation of computer-generated video holograms, said video hologramsallowing simultaneous reconstruction of a three-dimensional scene whilemaintaining the spatial resolution and reconstruction quality. Thisembodiment enables interactive real-time or near real-timereconstructions of given video holograms and transfer means. Anotherobject is to provide a method that allows large computer generatedholographic reconstructions to be generated; these can be as large as,and also larger than, the hologram itself.

This object is achieved by a method for computing a computer-generatedvideo hologram, where object data defining objects in a threedimensional scene is arranged into a number of virtual section layers,each layer defining a two-dimensional object data set, such that a videohologram data set can be calculated from some or all of thesetwo-dimensional object data sets; comprising the following steps:

(a) in a first transformation, each two-dimensional object data set ofthe virtual section layers is transformed to a two-dimensional wavefield distribution, and the wave field distribution is calculated for avirtual observer window in a reference layer at a finite distance fromthe video hologram layer,

(b) the calculated two-dimensional wave field distributions for thevirtual observer window, for all two-dimensional object data sets ofsection layers, are added to define an aggregated observer window dataset;

(c) in a second transformation, the aggregated observer window data setis transformed from the reference layer to the video hologram layer, togenerate the video hologram data set for the computer-generated videohologram.

The object data defining a three dimensional scene can be data defininga two dimensional scene, but including additional depth information forconverting two dimensional image or video data to three dimensionaldata. The term ‘three dimensional’ includes within its scope ‘twodimensional’. The depth information may be the same for all object datasets. Hence, the device that generates the hologram can switch from athree dimensional mode to a two dimensional mode, depending on theinputs and also what the user wishes to display.

The term ‘layers’ should be expansively construed to cover any kind ofvirtual definable structure that can describe the points that constitutethe scene that is reconstructed. It therefore includes any set ofvirtual parallel surfaces, and any algorithm that can spatially definethese points. However, virtual planar sections are computationally themost efficient form of layer to handle.

The term ‘plane’ should be expansively construed to include a non-planarsurface. The reference plane may coincide with the Fourier plane of thehologram (which is the same as the image plane of the illuminating lightsource); however, there is a degree of tolerance and an observer's eyesplaced sufficiently close to the Fourier plane will see a properlyreconstructed scene. The degree of tolerance increases as the pixelcount increases.

In one implementation, the first transformation is a Fresnel transformand the second transformation is a Fourier transform. The term‘transformation’ should be expansively construed to include anymathematical or computational technique that is equivalent orapproximates to a transformation. Transformations used in the normal,mathematical sense are merely approximations to physical processes moreaccurately described by Maxwellian wave propagation equations;transforms such as Fresnel transforms (or the special class of Fresneltransforms known as Fourier transforms) are second order approximations,but have considerable advantage: because they are algebraic as opposedto differential, they can be handled in a computationally efficientmanner.

In order to compensate for errors of the reconstructed aggregate fieldin the observer window, an iteration process may take place between thedistribution in the observer window and the hologram layer.

In order to reduce speckle noise, and enhance brightness or diffractionefficiency and brightness definition in the reference layer of thescene, the object data sets may exhibit an appropriate phasedistribution, e.g. a pseudo-random phase distribution.

In contrast to prior art solutions, by performing the first two of theabove steps according to this embodiment the hologram of a singleaggregated wave field is calculated using a diffraction formulae.Because of the superposition of all individual wave fields, thisaggregated wave field contains the entire optical information about thethree-dimensional scene within the achieved accuracy.

In a preferred embodiment of this embodiment all object data sets forthe section layers are assigned the same total number of discrete matrixpoints. If the number of matrix points is identical to the number ofscanning points in the hologram, fast algorithms can preferably be usedfor the entire computing process, and processing steps to adapt theresolution to the respective layer, such as interpolation or oversampling, become superfluous. The number of matrix points for all layersresults from the number of encoded pixels of the SLM in the hologramdisplay.

A major advantage of the embodiment in combination with the videohologram display known from WO 2004/044659 is that before transformingthe reference data set for the aggregated wave field in the hologramlayer, the area of the observer window(s) in the reference layer can berestricted so that it is considerably smaller than the area of the SLMlight modulator matrix. The extent of the observer window maximallycorresponds with the periodicity interval in the layer which containsthe image of the light source used for reconstruction, whenreconstructing the hologram in the reference layer. This leads to theeffect that the computer-generated video hologram according to thisembodiment only needs to realize lower diffraction angles compared withother solutions, all the more if the data sets for the reference layerand for the hologram layer have the same number of matrix point values.Thanks to the computation of amplitude values for the light modulatormatrix, the demands on processing speed are greatly reduced. Inparticular, in conjunction with a known position detection and trackingdevice for tracking the current viewer position, the dimension of theobserver window can be greatly minimized to benefit from this advantage.Further, WO 2004/044659, as noted earlier, requires computationallyintensive operations performed on every single point in the scene to bereconstructed. With the present embodiment, it is no longer necessary toperform a computationally intensive operation on every single objectpoint; instead, the first transformation (from each section layer to thevirtual observer window in the reference plane—where the observer's eyeswill be) is performed on entire section layers, rather than eachindividual object points in a layer. The second transformation goingback from the virtual observer window to the hologram layer is even moreefficient since it is just a single operation, yet encodes informationfor all object points.

In a further embodiment of this embodiment, each object data set of thesection layers is based on a virtual area size which depends on itsdistance to the reference layer. The section layer areas result fromimaginary faces running from the edges of the respective observer windowto the edges of the SLM of the video hologram. Because of the samenumber of matrix point values in each data set, the area assigned to theindividual matrix points changes in proportion to the distance to thereference layer. Assigning the original object data to the object datasets of the section layers that is also known as slicing, leads toassigning the discrete object point values of the scene to a respectivematrix point of a two-dimensional coordinate system that describes thematrix points on the respective section layer. According to the localposition of the object points with respect to the section layers, theoriginal object information is thereby assigned to the matrix points ofthe coordinate system which is closest to their spatial position. Thedistance-dependent areas of the section layers thus lead to the effectthat the area-dependent object point resolution to describe a sectionlayer of a scene is larger the closer the section layer is situated tothe reference layer. This means that while the foreground of a scene isreconstructed in detail, the same scene element in the background wouldbe reconstructed at a much lower resolution. However, the more distantvirtual section layers can reconstruct a much larger viewing area forthe background of the scene. This kind of reconstruction of a sceneprovides a very natural representation of foreground and backgroundelements of a scene on the one hand and helps minimizing the requiredcomputing power on the other.

In a preferred embodiment of this embodiment, the value for the distanceof each object data set of the virtual section layers can be chosen orchanged before transformation so that the entire reconstruction or partsof it appear in front of or behind the hologram layer. This way, both anatural position of the reconstruction in the depth of the space infront of the viewer's eyes and a deliberate amplification or reductionof the depth effect of a synthetic video hologram can be realizedthrough software settings alone.

When encoding according to the prior art method known from WO2004/044659, the reconstructed three-dimensional scene appears in thefree space in front of the viewer's eyes in the form of a wave fieldcontrolled by the light modulator matrix. The imaginary section layersused for computing also define the position of the reconstruction in thespace in front of the observer windows and are situated at a finitedistance to the reference layer. According to the conditions prevailingin an optical near field, this causes the light contribution of eachlight point, of the holographically reconstructed scene to theaggregated wave field, to propagate as a spherical wave to provide acontribution to the target wave front in the observer window in thereference layer. The transformation of each object data set in thereference layer can thus be expressed with adequate approximation by aFresnel transform. For this, the amplitude values of all object pointsof all object data sets are multiplied with a Fresnel phase factor,which depends on the distance of the respective section layer to thereference layer.

The Fresnel phase factor has an exponent which depends on the squareddifference of the coordinates between each original section layer andreference layer and other factors. Much processing time and computingpower are thus required to perform the many Fresnel transformations.According to a preferred embodiment of this embodiment, thisdisadvantage is compensated by dividing the difficult Fresneltransformations into individual steps so that these steps can beperformed with the help of fast Fourier transformations (FFT) inconjunction with further processing steps in the form of multiplicationswith spherical wave factors. This method has the advantage thatdedicated electronic hardware such as graphics and/or holographyadapters can be used for computing video holograms. Such hardwareincludes at least one dedicated graphics processor with known modulesfor slicing and other video processing steps, such as image rendering,and at least one specific processor module for performing the Fresneltransformations with the help of fast Fourier transformation routines.Such processors in the form of digital signal processors (DSP) with therequired FFT routines can be made inexpensively using known methods.Recent advantages in common graphics processors enable operations suchas Fourier transforming the data of the section layers into thereference layer using so called shading algorithms.

In order to simplify the computation of the wave fields, thetransformation which describes the propagation of light between theoriginal section layer and the reference layer is modified such that itcomprises a Fast Fourier Transformation (FFT) and two multiplicationswith phase factors describing spherical waves. The first phase factordepends on the coordinates in the original section layer and on thedistance between original section layer and reference layer. The secondphase factor depends on the coordinates in the reference layer and onthe distance between the original section layer and the reference layer.Depending on the collimation of light in the optical system one or bothof these phase factors may be set to a constant value.

Thus, the procedure of transforming the distribution of the sectionlayer into the reference layer can be broken into three steps:

1. The amplitude of each object point is multiplied by the first phasefactor.

2. The thus generated products are used for a first Fast FourierTransformation in order to transform the complex light amplitude of eachobject point from the original section layer to the reference layer.

3. The thus generated transform is multiplied with the second phasefactor.

The transform of the reference data set into the hologram layer, inorder to generate a hologram data set for the aggregated video hologramof the scene, can also be expressed by a transformation describing thelight wave propagation by a Fresnel transform. In order to be able toperform this step, the transformation is carried out according to thesteps described above, but before this transformation, the referencedata for all section layers in the reference layer are superimposed byway of a complex addition. Also for this Fresnel transform one or bothof the phase factors may be set to a constant value, depending on thecollimation of light in the optical system.

A particular advantage of this embodiment is that a reference data setfor an aggregated wave field is generated by adding the computedreference data sets of all section layers. After the transformation inthe hologram layer, this aggregated wave field serves as a basis for thevideo hologram as it contains the entire three-dimensional sceneinformation. This allows simultaneous reconstruction of thetwo-dimensional images of all section layers and thus the entire 3Dscene.

Another advantage arises when one wants to reduce common errors in thevideo hologram caused by the encoding process or by technologicallimits. For reducing the reconstruction errors of the video hologram aniteration process may be used. In the prior art, the object data of areconstructed three-dimensional scene has to be compared with theoriginal three-dimensional object scene. A complicated iteration processcomprising many transformations between the reconstructedthree-dimensional object scene and the hologram layer takes place untila desired reconstruction quality is reached. Our approach advantageouslyallows a much simpler iteration process. As the reference data setcontains the entire object information, the iteration process comprisestransformations between the hologram layer and the reference layer whichis only two-dimensional.

High-quality reconstructions with today's image rendering technologiesare just not possible without such correction processes.

The video holograms are preferably computed with the help of a digitalsignal processing device with slicer means, which assigns the objectinformation, including discrete object values for spatial distributionof the light amplitudes of a real or virtual three-dimensional scene,with matrix points of parallel virtual section layers, so that for eachsection layer, a separate object data set with object points in discretematrix points of the tomographic scene section layer is defined. Ahologram data set of a video hologram is computed from these object datasets. According to this embodiment the signal processing device furthercomprises:

First transformation means for computing from each object data set aseparate two-dimensional distribution of a wave field for the referencelayer situated at a finite distance, and buffer memory means forlayer-wise buffering the transformed object data sets,

Adding means for adding the transformed object data sets to generate anexpression of an aggregated wave field in a reference data set, and

Second transformation means for transforming the reference (aggregated)data set in a hologram layer situated at a finite distance and parallelto the reference layer, to generate the hologram data set for anaggregated video hologram of the scene.

The digital signal processing device comprises at least oneindependently acting transformation means for performing the Fresneltransformations, said transformation means containing:

First multiplication means for multiplying the amplitude value of matrixpoint values of an original data set with a first phase factordescribing spherical waves, the exponent of said factor depending on thesquared coordinates in the respective original layer (L_(m) or RL) andthe distance (D_(m)) to a target layer (RL or HL),

Fast Fourier transformation means for transforming the products of thefirst multiplication means from their original sectional layer to thetarget layer, and

Second multiplication means for multiplying that transform with anotherphase factor describing spherical waves, the exponent of said factordepending on the squared coordinates in the target layer and thedistance between target layer and original layer.

As mentioned before, depending on the collimation of light in theoptical system one or both of these phase factors may be set to aconstant value.

The digital signal processing device can be a multi-processor which hasseveral independently working sub-processors which simultaneouslyexecute transformation routines (TR1, TR2). In order to be able tosimultaneously execute at least a certain number of transformations, aresource manager is required which dynamically assigns thetransformations required for computation to the available transformationroutines depending on the content of the three-dimensional scene. Thedata sets transformed in the reference layer are buffered in buffermemory means.

This way, depending on the scene content, the data sets can be activatedat various points of time and even used several times if no changesoccur during scene motion in certain section layers.

For the execution of the Fast Fourier transformation, the object datasets of the virtual section layers are assigned a number N of discreteobject point values, said number N being an nth power of 2.

ANNEX I Brief Description of the Drawings

The functional principle according to the embodiment is described belowin detail with the help of a preferred embodiment and accompanyingdrawings.

FIG. 5A shows (not to scale) the arrangement for reconstructing thethree-dimensional scene and the reference layers required for thecomputation of video holograms.

FIG. 5B is a schematic diagram showing the signal processing device forcomputing video holograms according to this embodiment.

FIG. 5C is similar to FIG. 5A and illustrates the main steps of thecomputation according to this embodiment.

FIG. 5D illustrates the functional principle of the transformationmeans.

FIG. 5E illustrates the sub-steps executed to correct the matrix pointvalues of the computer-generated hologram.

ANNEX I Detailed Description of the Embodiment

The following indices refer to FIGS. 5A to 5E.

The computation of video holograms with a hologram processor is based onoriginal object information of a real or virtual three-dimensionalscene, including values for spatial distribution of the light amplitudesin an RGB or RGB-compatible format. These values are available in aknown file format and can be called up from a data memory by a hologramprocessor. This object information contains for example, in the case ofan object point file format BMP for each discrete object point of thethree-dimensional scene, a set of complex colour object point data Ro,Go, Bo for the respective two-dimensional coordinates. The data memoryMEM also provides depth information zo of the three-dimensional scene.It is irrelevant for the depth information zo for each point whether itis already provided in the first video image file or whether it iscomputed by the processor from at least one second file containingadditional information.

To facilitate understanding of the complex processes, one of the threespatial coordinates (here, the y coordinate) will be neglected in thefollowing description. The assignment of object points of the scene tomatrix points P₁₁ . . . P_(MN) in M section layers L₁ . . . L_(M)produces object data sets OS₁ . . . OS_(M) with N matrix point values.All data sets contain the same number N of matrix point values. Thisnumber N is determined by the number of pixels N1 of the light modulatormatrix which can represent N1 complex values. If a Fast-FourierTransform algorithm is used for calculation of the Fourier transform, Nhas to be reduced to a power of 2, i.e. N=2^(n) with n being an integernumber and N≦N1. E.g. for a display with N1=1280 pixels each data setcontains N=1024 matrix point values. However, other Fourier Transformalgorithms may be used which do not require 2^(n) input values and hencethe whole display resolution N1 could be used.

Seen in conjunction with FIG. 5B, FIG. 5A shows a preferred embodimentand illustrates how the scene is divided into a number M of virtualsection layers L₁ . . . L_(M) for computation by a slicer shown in FIG.5B. The slicer analyses in a known manner the depth information z of theoriginal object information stored in the data memory MEM, assigns eachobject point of the scene with a matrix point P_(mn), and entersaccording matrix point values in an object data set OS_(m) correspondingwith the section layer L_(m). For the indices, 0≦m≦M, and 1≦n≦N, where Nis the number of matrix points P in each layer and the number of matrixpoint values in a data set. On the one hand, the section layers L₁ . . .L_(M) are defined arbitrarily to determine discrete object data sets ofthe scene, irrespective of whether or not the scene exists in reality.On the other hand, the same section layers L₁ . . . L_(M) aim to definethe spatial position of the reconstructed scene 3D-S with respect to thevideo hologram. FIGS. 5A and 5B therefore show the desiredreconstruction 3D-S of the scene as defined locally with respect to thevideo hologram. Further definitions are necessary to be able to performthe computations: each section layer L_(m) is situated at a distanceD_(m) to a reference layer RL which has a observer window OW near whichthere are the viewer's eye(s) EL/ER. The video hologram is disposed in ahologram layer HL which is situated at a distance DH to the referencelayer.

As shown in FIG. 5B, the computation of the hologram matrix is continuedby performing the following steps:

Transformation of the object data sets OS₁ . . . OS_(M) of the sectionlayers L1 . . . LM in the reference layer RL so to determine the wavefield which would generate the complex amplitudes A₁₁ . . . A.sub.MN ofthe object points of each section layer Lm as a contribution to theaggregated wave field in the reference layer RL, if the scene wasexistent there.

Addition of the transformed object data sets DS₁ . . . DS_(M) with thecomponents Ã_(n) to form a reference data set RS that defines anaggregated wave field which is to appear in the observer window OW whenthe scene is reconstructed.

Back-transformation of the reference data set RS from the referencelayer RL to form a hologram data set HS in the hologram layer HLsituated at a distance of D_(H) to get matrix point values H₁ . . .H_(n) . . . H_(N) for encoding the video hologram.

The N pixel values for the video hologram are derived from the typicallycomplex values of the hologram data set. In the video hologram, thesevalues represent amplitude values and wave phases for modulating thelight during scene reconstruction.

It has been described above how 3D-S is reconstructed for the viewer ina observer window OW. In order to be able to perceive three-dimensionalscenes in a true three-dimensional manner, as if the object was viewedin reality, different holograms are needed in the respective observerwindows for each eye.

The hologram matrix for the second observer window is computed in thesame way, but with accordingly altered matrix point values. Thealterations result from the different positions of both viewer's eyeswith respect to the scene 3D-S. The two hologram matrices can becomputed at the same time and absolutely independently of each other inaccordingly equipped multi-channel digital signal processors withsimultaneously working FFT routines. In order to reduce the requiredcomputing power, computation results of object data sets which show onlylittle or no difference in content may be jointly used. This may applyto section layers which show a picture background. Both eyes will thensee the same scene, but from slightly offset directions.

According to a particular feature of this embodiment, the digital signalprocessing device contains an object data set manager which compares thecontents of corresponding object data sets to alternately assign onlyone of the two identical object data sets to one of the two signalprocessor channels for transformation and thus avoid superfluousprocessing.

In contrast to known solutions, the reconstructions are viewed throughthe virtual observer windows in frustum-shaped spaces which are definedby imaginary connection faces A1 and A2 stretching from the observerwindows OW to the light modulator matrix LM. The 3D-S reconstructionsmay appear in front of, on or behind the video hologram layer HL orintersect this layer.

The observer window size is sufficient if it covers the lateral size ofan eye, in special cases even it may be reduced to pupil size. Assuminga observer window of 1×1 cm² disposed at a distance of 1 m to thehologram layer, the number of pixels required for the computer-generatedvideo hologram is reduced by a factor of 2,500 . . . 10,000 comparedwith a light modulator matrix with classic encoding methods.

FIG. 5C shows the position of selected layers for the execution of thetransformations required for the computation. Only the first virtualsection layer L₁ and one further layer L_(m) are shown. However, thecontribution of all wave fields is always required to compute the wavefield of the section layers L₁ . . . L_(m) in the reference layer RL. Inorder to save computing power, when processing moving three-dimensionalscenes, individual transformed data sets DS₁ . . . DS_(m) can bebuffered and re-used for several subsequent video holograms until thereoccurs a change in content.

FIG. 5D shows in detail how the amplitude values A_(m1) . . . A_(mn) . .. A_(mN) of an object data set OS_(m) of a section layer L_(m) at adistance of D_(m) to the reference layer RL are transformed. Tofacilitate understanding of this complex process, only a one-dimensionaltransformation is shown. Equation (1) shows the core of a Fresneltransformation.

  (1)

where the term

-   -   Error! Objects cannot be created from editing field codes.

denotes the core of a Fourier transformation from a layer with thecoordinates x_(m) in a layer with the coordinates x₀, i.e. from asection layer situated at a distance of D_(m) in a reference layer.

As mentioned before, depending on the collimation of light in theoptical system one or both of these quadratic phase factors may be 1.

The equation (2)

-   -   Error! Objects cannot be created from editing field codes.        defines the amplitude        Error! Objects cannot be created from editing field codes. of a        matrix point value multiplied with the corresponding phase        factor F1_(mn) in the layer L_(m).

Finally, equation (3) shows the result of the Fourier transform of (2)and the multiplication with a phase factor which solely depends on thecoordinates x₀ of the observer window OW in the reference layer and thedistance of the respective section layer to the reference layer. Itdefines the complex amplitude in a matrix point of the observer windowin the reference layer.

$\begin{matrix}{{\overset{\sim}{A}}_{mn} = {{\overset{\sim}{A}}_{mn}^{\prime}^{j\frac{k}{2D_{m}}x_{0}^{2}}}} & (3)\end{matrix}$

The described solution allows accelerating the computing process so thata dedicated digital signal processor circuit can perform the computationof a sequence of video holograms of a moving scene for both eyes in theform of a real-time non-flickering reconstruction.

In order to compensate for errors of the reconstructed aggregate fieldin the observer window OW, in a preferred embodiment of the embodimentan iteration process shown in FIG. 5E can applied for the calculationbetween the distribution in the observer window OW and the hologramlayer HL.

ANNEX I Characteristics of this Embodiment

The following indices refer to FIGS. 5A to 5E.

1. Method for computing a computer-generated video hologram, whereobject data defining objects in a three dimensional scene is arrangedinto a number of virtual section layers (L₁ . . . L_(M)), each layerdefining a two-dimensional object data set (OS_(m)), such that a videohologram data set (HS) can be calculated from some or all of thesetwo-dimensional object data sets (OS₁ . . . OS_(M)); comprising thefollowing steps:

(a) in a first transformation (TR 1), each two-dimensional object dataset (OS n) of the virtual section layers is transformed to atwo-dimensional wave field distribution, and the wave field distributionis calculated for a virtual observer window (OW) in a reference layer(RL) at a finite distance (D_(M)) from the video hologram layer (HL),

(b) the calculated two-dimensional wave field distributions (DS₁ . . .DS_(M)) for the virtual observer window (OW), for all two-dimensionalobject data sets of section layers (L₁ . . . L_(M)), are added to definean aggregated observer window data set (RS);

(c) in a second transformation (TR 2), the aggregated observer windowdata set (RS) is transformed from the reference layer to the videohologram layer (HL), to generate the video hologram data set (HS) forthe computer-generated video hologram.

2. Method according to characteristics 1, where the data of the videohologram data set (HS) is assigned to equally spaced points in the videohologram and these points are organized as a matrix.

3. Method according to characteristics 1, where the section layers (L₁ .. . L_(M)), the hologram layer (HL), the reference layer (RL) and thevirtual observer window (OW) are planar.

4. Method according to any preceding characteristics, where the videohologram layer (HL), the section layers and the virtual observer windoware parallel to each other.

5. Method according to any preceding characteristics, where at least oneeye of an observer is located near the virtual observer window, so thata reconstructed scene can be seen through the virtual observer window(OW).

6. Method according to any preceding characteristics, in which there aretwo or more virtual observer windows (OW).

7. Method according to characteristics 1, where the object data (R₁, G₁,B₁, z₁ . . . R_(P), B_(P), B_(P), z_(P)) are assigned to object datasets (OS₁ . . . OS_(M)), all of which comprise the same number (N) andmatrix structure of values as the aggregated observer window data set(RS) and the hologram data set (HS), where the number and structure ofvalues for all data sets (OS₁ . . . OS_(M), RS, HS) is derived from thenumber of pixels used for encoding the video hologram.

8. Method according to characteristics 2, where the two-dimensionalobject data sets (OS₁ . . . OS_(M)) and the aggregated observer windowdata set (RS) have the same matrix structure as the video hologram dataset (HS).

9. Method according to any preceding characteristics where the virtualobserver window (OW) in the reference layer is set to be smaller than orequal to the size of a periodicity interval in the reference layer andlocated completely within one periodicity interval.

10. Method according to any preceding characteristics in which thereference layer co-incides with the Fourier plane of the hologram.

11. Method according to characteristics 1, where each object data set(OS_(m)) is based on the area of the corresponding section layer(L_(m)), which depends on its distance (D_(m)) to the reference layer(RL).

12. Method according to characteristics 11, where the area of eachsection layer is defined by intersections with imaginary faces (A1, A2)which connect the edges of the virtual observer window (OW) and theedges of the video hologram.

13. Method according to characteristics 1, where the sections layers(L_(m)) have distance (D1 . . . D_(m)) to the virtual reference layer(RL) are set such that the entire reconstructed scene (3D-S) or parts ofit appear in front of and/or behind the hologram layer (HL).

14. Method according to characteristics 1, where the firsttransformation is a Fresnel transformation which comprises the followingsub-steps:

Multiplication of the amplitude value Amn of each object point of anoriginal section layer (L_(m)) with a first phase factor describingspherical waves (F1_(mn)), the exponent of said factor depending on thesquared coordinates (x_(m), y_(m)) in the original section layer (L_(m))and the distance (D_(m)) between the original section layer (L_(m)) anda reference layer (RL),

Transformation of the thus calculated products for each object point(A_(m1) . . . A_(mN)) of the original section layer (L_(m)) with thehelp of a first fast Fourier transformation (FFT) from the originalsection layer (L_(m)) to the reference layer (RL),

Multiplication of the thus calculated transforms (Ã′_(m1) . . . A′_(mN))with a second phase factor describing spherical waves (F2_(mn)), theexponent of said factor depending on the squared coordinates (x, y) inthe reference layer (RL) and the distance (D_(m)) to the originalsection layer (L_(m)).

1. Method according to characteristics 1, where the secondtransformation is also a Fresnel transformation which comprises thefollowing sub-steps:

Multiplication of each complex amplitude value (Ãn) of the referencedata set (RS) with a third phase factor describing spherical waves(F3_(n)), the exponent of said factor depending on the squaredcoordinates (x₀, y₀) in the reference layer (RL) and the distance(D_(m)) between the reference layer (RL) and the hologram layer (HL),

Transformation of the thus calculated products of the complex amplitudevalues (Ã₁ . . . Ã_(N)) with the help of a second fast Fouriertransformation (FFT) from the reference layer (RL) to the hologram layer(HL),

Multiplication of the thus calculated transforms (H′₁ . . . H′_(N)) witha fourth phase factor describing spherical waves (F4_(n)), the exponentof said factor depending on the squared coordinates (x, y) in thehologram layer (HL) and the distance (D_(H)) between the hologram layer(HL) and the reference layer (RL), so to get the desired hologram values(H₁ . . . H_(N)) for the hologram data set (HS) used for encoding.

1. Method according to characteristics 14 or characteristics 15 whereone or both of the phase factors describing spherical waves (F1_(mn),F2_(mn)) may be set to a constant value.

2. Method according to characteristics 1, where the first and/or secondtransformation is a Fourier transformation.

3. Method according to characteristics 1, which comprises the followingsub-steps for correcting point values of the computer-generated videohologram by way of iteration:

A) the observer window data set (RS) from an original three-dimensionalscene is defined as a target function for the first transformation,

B) back-transformation of the original complex amplitude values (Ã₁ . .. Ã_(N)) of the target function to the hologram layer (HL) to get matrixpoint values (H₁ . . . H_(N)) of the hologram data set (HS),

C) derivation of parameters (Paramn) of the hologram data set (HS) for alight modulator matrix (LM),

D) transformation of the Derivation of parameters (Paramn) to thereference layer (RL) to get a distribution of complex up-dated amplitudevalues (Ã₁′ . . . Ã_(N)′) in the virtual observer window (OW),

E) forming a difference (A) of the distribution of complex up-datedamplitude values (Ã₁′ . . . Ã_(N)′) and original values (Ã₁ . . . Ã_(N))of the target function,

F) back-transformation of this difference (Δ) to a distribution ofdifference point values (ΔH₁ . . . ΔH_(N)) in the hologram layer (HL),

G) subtraction of the distribution (ΔH) from the video hologram data set(HS) and updating the hologram data set,

H) repeating of the steps C) to G)

I) termination of the iteration when the approximation accuracy has beenreached.

1. The method of any preceding Characteristics in which depthinformation is the same for all object data sets.

2. The method of Characteristics 19 in which a device that generates thehologram can switch from a three dimensional mode to a two dimensionalmode, depending on the inputs and/or what mode the user selects.

3. Digital signal processing device for computing computer-generatedvideo holograms with digital slicer means, which assigns object datadefining objects in a three dimensional scene to a number of virtualsection layers (L₁ . . . L_(M)), each section layer defining a separateobject data set (OS_(n)), such that a video hologram data set (HS) for avideo hologram can be calculated from some or all of these object datasets, containing:

(a) first transformation means (TR1) for computing from each object dataset (OS_(m)) a separate, two-dimensional wave field distribution for avirtual observer window in a reference layer (RL) situated at a finitedistance (D_(M)), and buffer memory means for buffering transformedobject data sets,

(b) adding means (AD) for adding the transformed object data of allsection layers to generate a wave field expression of an aggregatedobserver window data set (RS), and

(c) second transformation means (TR2) for transforming the observerwindow data set (RS) to a hologram layer (HL) situated at a finitedistance and parallel to the reference layer (RL), to generate thehologram data set (HS) for the aggregated video hologram.

1. Device according to characteristics 21, which comprises at least oneindependently working transformation means (TR1, TR2) for performingtransformations, said device containing:

First multiplication means (M1) for multiplying the amplitude value(A_(mn)/Ã_(n)) of values of an original object data set (OS_(m)) with afirst phase factor describing spherical waves (F1_(mn)/F3_(n)), theexponent of said factor depending on the squared coordinates (x_(m),y_(m)) in the respective original layer (L_(m) or RL) and the distance(D_(m)) to a target layer (RL or HL),

-   -   Fast Fourier transformation means (FFT) for transforming the        products of the first multiplication means (M1) from their        original layer (L_(m)/RL) to the target layer (RL/HL), and    -   Second multiplication means (M2) for multiplying that transform        with another phase factor describing spherical waves        (F2_(mn)/F4_(n)), the exponent of said factor depending on the        squared coordinates in the target layer and the distance between        target layer and original layer.

1. Device according to characteristics 22, where for the execution ofthe fast Fourier transformations all data sets have a number (N) ofdiscrete matrix point values, said number (N) being an nth power of 2.

2. Device according to characteristics 21, which includes amulti-channel digital signal processor (DSP) for independent andsimultaneous execution of frequently re-occurring computation routines.

3. Device according to characteristics 21, which includes a multitude ofindependently working sub-processors which comprise simultaneouslyexecuted transformation routines (TR1, TR2), and a resource managerwhich dynamically assigns the transformations required for computationto the available transformation routines depending on the content of thethree-dimensional object, in order to be able to simultaneously executeat least a certain number of transformations.

4. Device according to characteristics 21, which is a multi-channelprocessor for simultaneous computation of the hologram data sets(HS_(L), HS_(R)) for both eyes.

5. Device according to characteristics 21, which includes object dataset controlling means for comparing the contents of corresponding objectdata sets (OS_(m)) in hologram computations with different originalobject data, in order to execute like transformations only once in oneof the two signal processor channels and to co-use the transforms in theother channel.

6. Device according to characteristics 21, where one or all of the phasefactors describing spherical waves (F1_(mn)/F3_(n), F2_(mn)/F4_(n)) maybe set to a constant value.

7. Device according to Characteristics 21 adapted to switch from a threedimensional mode to a two dimensional mode, depending on the inputsand/or what mode a user selects.

ANNEX II Theoretical Background: Detail and Enhancements to thePreferred Embodiments

This section gives further theoretical background to the embodimentsmentioned above.

1. Diffraction Orders and Observer Windows Description of PeriodicRepetitions of a Diffraction Pattern.

a) The pixelation of a hologram on an SLM leads to a periodic repetitionof the diffraction pattern in the viewing plane. The observer window hasto be within one periodicity interval, i.e. the observer window has tobe smaller than the periodicity interval. The pixel pitch of the SLM andthe encoding method of the complex-valued hologram on the SLM determinethe size of the periodicity interval and how much of it can be used as aobserver window.

b) The standard LCD panels modulate mostly the amplitude and can be usedas amplitude-modulating SLMs for displaying the hologram. One method toencode the complex-valued hologram data on an amplitude-modulating SLMis Burckhardt encoding which is based on the detour-phase effect. A setof three neighbouring pixels is needed to encode one complex value.

For Burckhardt encoding the diffraction orders (−1^(st), 0^(th), 1^(st),2^(nd), 3^(rd), etc. diffraction order) can be classified into threecategories:

-   -   0^(th), 3^(rd), etc. diffraction orders, containing undiffracted        light without object reconstruction    -   1^(st), 4^(th), etc. diffraction orders, containing the        reconstruction of the object    -   1^(st), 2^(nd), etc. diffraction orders, containing the        reconstruction of a depth-inverted object

The reconstructed object can be seen in the 1st, 4th, etc. diffractionorders. Due to the finite aperture of the LCD pixels the intensity ofthe diffraction pattern falls off towards higher diffraction orders.Therefore it is advantageous to locate the observer window in the 1stdiffraction order.

Not a single diffraction order is periodically repeated but the set of1^(st), 0^(th) and −1^(st) diffraction orders together. Hence, theperiodicity interval comprises the 1^(st), 0^(th) and −1^(st)diffraction orders. Its size is given by

P _(—) _(diffr) =λ*d/p

d is the distance between hologram and viewing plane, p is the pixelpitch and λ is the wavelength.

As the object is reconstructed in the 1^(st) diffraction order and notin the −1^(st) or 0^(th) diffraction order, the observer window cannotcover the whole periodicity interval but only the 1^(st) diffractionorder. The size of the 1^(st) diffraction order is ⅓ of the periodicityinterval P_(diffr).

c) With a complex-modulating SLM each single pixel can be used to encodeone complex number. Therefore, each periodicity interval in the viewingplane contains only one diffraction order. Hence, the whole periodicityinterval can be used as an observer window.

If a phase-modulating SLM is used in a Fourier hologram the periodicityinterval contains no reconstruction of a depth-inverted object. However,there is also undiffracted light. Therefore, not the whole periodicityinterval can be used as a observer window, but most of it. Theundiffracted light has to be excluded from the observer window.

d) In general we might say that the observer window has to be within oneperiodicity interval. Each periodicity interval contains not only thereconstructed object but also undiffracted light and in some cases adepth-inverted object. The fraction of the periodicity interval whichcan be used for the observer window depends on the SLM and the encodingscheme. The size and the position of the observer window within thediffraction order have to be determined appropriately. Care has to betaken that only the reconstructed object can be seen in the observerwindow and no depth-inverted object or undiffracted light.

e) General quantitative description of observer window size:

In our terminology the periodicity interval comprises not only thediffraction order in which the reconstructed object can be seen, but(depending on the encoding technique) also the diffraction orderscontaining undiffracted light and depth-inverted object. The extent ofthe periodicity interval is mainly determined by the pixel pitch, i.e.it is fixed for a given SLM. This means that the observer window can beenlarged by optimizing the encoding technique. If N pixels are needed toencode one complex number the maximum size of the observer window is 1/Nof the periodicity interval, e.g.:

Burckhardt encoding on (mostly) amplitude-modulating SLM:

3 pixels per complex number=>maximum size of observer window=⅓ ofperiodicity interval

Double-phase encoding on (mostly) phase-modulating SLM:

2 pixels per complex number=>maximum size of observer window=½ ofperiodicity interval

Kinoform encoding on (mostly) phase-modulating SLM:

1 pixel per complex number=>maximum size of observer window=periodicityinterval 2 Size of the Observer Window

a) In conventional electro-holographic displays the hologram iscalculated as the Fourier Fresnel transform of the objects. This leadsto a small object size if low-resolution SLMs are used. In contrastthereto, in our electro-holographic display the hologram is calculatedas the Fourier transform of the observer window.

This leads to a small observer window if low-resolution SLMs are used.

The observer window serves only as a window through which the observercan view the reconstructed 3D scene. The small observer window does notmatter if it is larger than the eye pupil and if the eye pupil isproperly tracked.

b) The occurrence of multiple object reconstructions in a frustrumdefined by the SLM and the observer window can be avoided if:

Either the encoded area is appropriately limited. This can be done witha geometrical construction (cf FIG. 2 and Annex III, concept C). Theobject is sampled in object points. The hologram information of eachobject point is encoded only in a small encoded area whose size andposition can be seen in FIG. 3. The encoded areas orelementary/projection holograms of all object points are superimposed onthe hologram.

Equivalent to the superposition of the projection holograms is to slicethe object into object planes. The object is limited by the frustrum.Each object plane is propagated with a Fresnel transform to the observerwindow where all Fresnel transforms are added. The summed Fresneltransforms are then Fourier-transformed to the hologram plane. Thismethod inherently implies that no multiple reconstructions can be seenfrom the observer window.

c) Based on this method a prototype display was built. Using acommercial 20″ monochrome LCD panel with 69μ pixel resolution a observerwindow with size 6 mm at a distance of 2 m is possible. This results inan electro-holographic display with 20″ screen diagonal.

3 Multiplexing of Several Observer Windows

By reducing the observer window to a size slightly larger than the eyepupil the resolution and (therefore the number of SLM pixels) can besignificantly reduced. This implies that for one observer at least twoobserver windows are necessary. In each observer window a reconstructionof the object in an appropriate perspective can be seen. Either temporalor spatial multiplexing of the observer window can be used.

a) Temporal multiplexing means that the observer windows are generatedsequentially. This can be done by synchronous switching of the lightsources and the hologram panel (SLM). Thus the viewer's eyes aresequentially illuminated. To avoid flickering the switching rate has tobe sufficiently high, i.e. preferably at least 25 Hz. This requires fastLCD panels which are currently hardly available as large monochromepanels.

b) Spatial multiplexing means that all observer windows are displayed atthe same time. Care must be taken that the observer windows arespatially separated in the viewing plane so that no overlap orcross-talk occurs. This can be done e.g. by interlacing two or moreholograms on the SLM and a beam splitter such as a barrier mask. Alsoother optical elements for image separation/beam splitting or techniquesknown from autostereoscopic displays can be used, e.g. prism masks orlenticular masks.

4 Horizontal and/or Vertical Parallax

A full-parallax hologram reconstructs an object holographically bycoherent superposition of waves in the horizontal and verticaldirections. Given a sufficiently large observer window or observerregion the reconstructed object facilitates motion parallax inhorizontal and vertical direction, like a real object. However, a largeobserver region requires high resolution in both horizontal and verticaldirection of the SLM.

Often, the requirements on the SLM are lessened by restricting to ahorizontal-parallax only (HPO) hologram. The holographic reconstructiontakes place only in horizontal direction whereas there is no holographicreconstruction in vertical direction. This results in a reconstructedobject with horizontal motion parallax. The perspective view does notchange upon vertical motion. A HPO hologram requires less resolution ofthe SLM in vertical direction than a full-parallax hologram. There isonly a periodicity in the reconstruction direction, i.e. horizontally.The computational load is decreased for one-dimensional line holograms.

A vertical-parallax only (VPO) hologram is also possible but uncommon.The holographic reconstruction takes place only in vertical direction.This results in a reconstructed object with vertical motion parallax.Also eye accommodation (adapting the eye lens curvature to the objectdistance) is accomplished by a VPO hologram as it is with a HPOhologram. There is no motion parallax in the horizontal direction. Thedifferent perspective views for left eye and right eye have to becreated separately. This can be done by temporal or spatial multiplexingof the observer windows, as described above.

5 Colour Holograms

Colour holograms can either be generated with temporal or spatialmultiplexing. For temporal multiplexing R, G and B light sources areswitched synchronously with the corresponding hologram contents on theSLM. For spatial multiplexing three R, G and B holograms are displayedon interlaced R, G and B pixels, illuminated by a spatially coherentwhite light source or separate R, G and B sources.

6 Continuous SLM

A pixelated SLM (e.g. an LCD panel) as hologram-bearing medium leads toperiodic repetitions of the reconstructed object and of the observerwindow. By using the methods described in this specification it can beavoided that multiple reconstructions of the object are seen by theobserver. Therefore, our method is preferably applied to pixelated SLMs.

However, our method can also be applied to continuous SLMs, e.g. anoptically addressed spatial light modulator (OASLM). An OASLM itself iscontinuous and would hence not require those aspects of the embodimentthat eliminate multiple reconstructions for the observer. However, theOASLM is usually optically addressed with an electrically addressed SLM,which does have a pixel structure. This may result in a residual pixelstructure on the OASLM and therefore periodic replications of the objectin the observer window may occur. Hence it may be useful to apply ourmethod to an OASLM or other continuous SLMs.

7 Combination of HPO Hologram and Spatial Multiplexing

Spatial multiplexing of horizontally aligned observer windows ispreferably used in combination with a VPO-Vertical ParallaxOnly-hologram. Horizontally aligned observer windows require beamsplitting elements which split the beams emanating from the SLMhorizontally. A VPO hologram can be illuminated by horizontal line lightsources which are spatially incoherent in the horizontal direction.Therefore, in the horizontal direction, the observer window is limitedonly by the optical elements for beam splitting, which can be treated inthe same way as for conventional autostereoscopic displays. Thelimitation of the observer window due to the periodicity interval anddiffraction orders only applies in the vertical direction, where thehorizontal line light sources are spatially coherent. In the horizontaldirection, there is no mutual interference between diffraction and beamsplitting.

In principle, it is also possible to combine a HPO hologram and spatialmultiplexing of horizontally aligned observer windows. However, caremust be taken because beam splitting and diffraction now both operate inhorizontal direction.

8 Coherence of the Light Source

We have to distinguish between temporal and spatial coherence.

a) Spatial coherence is related to the lateral extent of the lightsource. Light from a laser source can be regarded as emanating from apoint source (within diffraction limits and depending on the modalpurity) and leads to a sharp reconstruction of the object, i.e. eachobject point is reconstructed as a point (within diffraction limits).Light from a spatially incoherent source, e.g. a LED or a CCFL, islaterally extended and causes a smearing of the reconstructed object.The amount of smearing is given by the broadened size of an object pointreconstructed at a given position. In order to use a spatiallyincoherent source for hologram construction, a trade-off has to be foundbetween reconstruction quality and brightness by adjusting the aperturewidth. A smaller aperture results in improved spatial coherence andhence lowers the degree of blurring or smearing. But a smaller apertureresults in a lower brightness. The term “partial spatial coherence” isused to describe the sources.

b) Temporal coherence is related to the spectral line width of the lightsource. The diffraction angle at the SLM is proportional to thewavelength which means that only a monochromatic source will lead to asharp reconstruction of an object point. A broadened spectrum will leadto broadened object points and smeared object reconstructions. Thespectrum of a laser source can be regarded as monochromatic. Thespectral line width of a LED is sufficiently narrow (ca. 20 nm FWHM) tofacilitate good reconstructions.

9 Point Light Sources and Parallax

For a hologram with full parallax one or several point sources incombination with one single rotationally symmetrical lens or an array ofrotationally symmetrical lenses have to be used. Preferably, for ahologram with HPO or VPO one or several line light sources are used incombination with a single cylindrical lens or an array of cylindricallenses (lenticular). The line light sources and the lenses have to bealigned parallel.

Line light sources have the advantage of higher brightness, lenticularsare easier to manufacture than arrays of rotationally symmetricallenses.

However, also other combinations are possible for HPO or VPO:

point source(s) and rotationally symmetrical lens/lens array

point source(s) and cylindrical lens/lenticular

line source(s) and rotationally symmetrical lens/lens array

10 Combinations of Light Sources and Lenses

The light sources may be spatially coherent sources (e.g. lasers) orsources with sufficient partial spatial coherence (e.g. LED withsufficiently small aperture).

Different types of light sources arrangements:

-   -   one point source    -   1D array of point sources    -   2D array of point sources    -   one line source    -   array of line sources

Preferable orientations of line sources and arrays will be discussedbelow.

Different types of lens arrangements:

-   -   one large rotationally symmetrical lens    -   1D array of rotationally symmetrical lenses    -   2D array of rotationally symmetrical lenses    -   one large cylindrical lens    -   array of cylindrical lenses (lenticular)

Preferable orientations of cylindrical lenses and lens arrays will bediscussed below. For simplification the terms “rotationally symmetricallens” and “cylindrical lens” may refer to spherical cross sections ofthe lens and aspherical cross sections. Aspherical cross sections may beused to reduce spherical aberrations. There are preferable combinationsof light sources and lenses:

a) One point source and one rotationally symmetrical lens. Thiscombination is the easiest for small displays. It is preferably used forfull-parallax holograms. For larger displays, i.e. diagonal larger thanseveral inches, the required high-intensity point source and the largebulky lens make this combination inappropriate.

b) 2D array of point sources and 2D array of rotationally symmetricallenses. This combination is preferable for large full-parallaxholograms. Each point source corresponds to one lens. Each light sourcehas to illuminate only a single lens of the lens array which facilitatesto split the required amount of total intensity to many light sources.This lessens the requirements on the intensity of each light source.Also a lens array is much easier to fabricate and less bulky than asingle large lens with the same focal length.

c) Array of vertically aligned line sources and array of verticallyaligned cylindrical lenses (vertically aligned lenticular). Thiscombination is used for HPO holograms. The vertically alignedcylindrical lenses focus the light in horizontal direction resulting ina HPO hologram. In the vertical direction there is no motion parallax.Each line source corresponds to one lenticule. Compared to a 2D array ofpoint sources and a 2D array of lenses there is the advantage that alenticular is easier to fabricate than a 2D array of lenses. Also therequirements on the intensity in a line light source are lower than fora point source: the light flux is distributed on a line and notconcentrated on a small spot.

d) Array of horizontally aligned lines sources and array of horizontallyaligned cylindrical lenses (horizontally aligned lenticular).

This combination is used for VPO holograms. The horizontally alignedcylindrical lenses focus the light in the vertical direction, resultingin a VPO hologram. Without additional means there is no motion parallaxin the horizontal direction. Each line source corresponds to onelenticle. This combination of sources and lenticular may be furthercombined with optical elements for conventional autostereoscopic imageseparation. The VPO hologram with coherent superposition of waves in thevertical direction is not influenced by the autostereoscopic imageseparation in the horizontal direction and vice versa. This results in acombination of a holographic and an autostereoscopic display. Theholographic reconstruction in vertical direction satisfies eyeaccommodation. The autostereoscopic image separation together withspatial multiplexing generates different perspective views for left eyeand right eye.

11 Types of Light Sources

There are different possibilities to generate the light sources, e.g.:

a) A single point light source may be a laser diode or another type oflaser. A LED can be used if the aperture of the diode is sufficientlysmall to ensure sufficient spatial coherence. An additional aperture mayhave to added.

b) An array of point sources can be generated by e.g.:

-   -   An array of single point sources, e.g. laser, LED    -   A single laser or LED which is coupled into an optical fiber        bundle. The outputs of the fiber bundle are appropriately        arranged to form the desired source array.    -   A large area illumination composed of several lasers, LEDs,        CCFLs, etc. The light emanating from these sources is then        shaped by an array of apertures. This array of apertures may be        static or configurable, e.g. it may be a LCD panel (shutter        panel) which is transparent only at the locations of the desired        point light sources. The configurable apertures on a LCD panel        is preferably used to shift the light sources for observer        tracking.

c) An array of line light sources can be generated by e.g.:

-   -   An array of point sources which are aligned in lines, e.g.        laser, LED    -   An array of point sources which are extended in one direction by        1D diffuser sheets, lenticulars, etc.    -   A large area illumination composed of several lasers, LEDs,        CCFLs, etc. The light emanating from these sources is then        shaped by an array of stripe-like apertures. This array of        apertures may be static or configurable, e.g. it may be a LCD        panel (shutter panel) which is transparent only at the locations        of the desired line light sources. The configurable apertures on        a LCD panel is preferably used to shift the light sources for        observer tracking.

d) Instead of a large-area illumination and an aperture on a LCD panelto generate a configurable array of point or line sources an OLED panelmay be used. An OLED panel is an array of small organic light emittingdiodes with a pitch of the order of 100 μm. The desired array of pointor line sources can be generated if only the appropriate OLED pixels areswitched on.

e) Also other sources may be used to generate single point sources,arrays of point sources and arrays of lines sources, e.g. CCFL, metalvapour lamps (e.g. Hg vapour lamp). An appropriate aperture may have tobe applied to ensure sufficient spatial coherence.

f) A single source replicated by an array of lenses or a single hologramexhibiting this feature. The output may be an array of points orlines/columns or an array/line/column of extended light beams witharbitrarily shaped wavefront. For instance, an array of lines can beformed to serve directly as illumination for the hologram.

12 Mutually Incoherent Light Sources and Sub-Holograms

The light sources of an array of light sources are usually mutuallyincoherent. This means that there is no fixed phase relation betweenthem. There will be no coherent superposition of waves emanating fromdifferent light sources.

In relation to a hologram which is illuminated by an array of lightsources and through an array of lenses, this means that there is nocoherent reconstruction across the whole hologram-bearing medium/SLM.Rather, the hologram is split in several sub-holograms belonging toindividual light sources and lenses. Each of the sub-holograms iscoherently illuminated and reconstructs the sub-object which is encodedon this sub-hologram. As there is no mutual coherence between thesub-holograms, the sub-objects do not superimpose coherently butincoherently. This results in an addition of the intensities instead ofthe amplitudes and leads to a lower intensity of the reconstructedobject. Still, there is a reconstructed object which is composed ofseveral sub-objects.

The effect of mutually incoherent light sources is less than forconventional holograms. The hologram information for an object point isnot encoded on the whole hologram but only in a small encoded area. Thetypical size of an encoded area is several millimeters. This isapproximately the same size as the typical pitch of the light sourcesand hence the typical pitch of the lens array. Therefore an encoded areais illuminated by only few and not by many mutually incoherent lightsources.

Composing the hologram of many small encoded areas and splitting theillumination in many mutually incoherent sources also facilitates theuse of low-coherence sources like LEDs. Coherence is needed only acrossan area with extent of several millimeters and not across the wholehologram. Coherent illumination of a 20″ hologram would requirehigh-coherence sources like lasers.

13 Focusing of Light Sources in the Observer Plane

A Fourier hologram requires that the light sources are imaged to theobserver plane. The imaging is done with a lens or a lens array.Compared to a Fresnel hologram the Fourier hologram has the advantagethat undiffracted light is focused to small spots in the observer plane.If these spots are outside the observer window the undiffracted light isnot visible as disturbing background.

In the case of a coherent light source the size of the imaged lightsource is limited by diffraction and aberrations at the lens and isusually very small (compared to the resolution of the human eye). In thecase of a spatially incoherent source (e.g. LED) the size of the imagedlight source is also determined by the aperture of the light source andmagnification of the lens.

If an array of light sources and an array of lenses are used, the imagesof all light sources have to coincide. This means that the pitch of thelight source array has to be slightly larger than the pitch of the lensarray, according to a simple geometrical construction. If the sourcesand lenses are properly aligned a diffraction pattern is visible in theobserver plane which looks like the diffraction pattern as if a singlesource and a single lens was used.

There may be additional optical elements which shape the lightdistribution in order to homogenize the light distribution or increasethe intensity in the observer plane. These may be diffuser sheets orlenses.

14 Tracking

For a pure holographic setup tracking of the observer is achieved byshifting the light source(s) relative to the lens (array). This may bedone by mechanically shifting the source(s) or the lens (array) or byelectronically shifting the apertures on the shutter LCD panel. Trackingmight also be done by a configurable diffractive optical element or ascanning mirror.

If holographic object reconstruction in vertical direction andautostereoscopic image separation in horizontal direction are combined,tracking in horizontal direction can also be done by horizontal shiftingof the VPO hologram on the SLM.

15 Types of SLM

The SLM may be a cell based/pixelated or a continuous SLM.

Cell Based

-   -   Liquid crystal (transmissive or reflective)    -   amplitude modulating    -   phase modulating    -   combined amplitude and phase modulating

MOEMS (Micro Optical Electro Mechanical Micro System)

-   -   piston    -   other types of cell based SLM

Continuous

-   -   optically addressed SLM (OASLM)    -   Acousto optic modulator (AOM)    -   other types of continuous SLM

16 Description of a Characteristic Embodiment

In a characteristic embodiment a monochrome LCD panel with 20″ diagonalis used as hologram-bearing medium. The pixel pitch is 69 μm in verticaldirection and 207 μm in horizontal direction. The LCD modulates theamplitude of the light.

The hologram is illuminated by an array of horizontal line light sourcesand a lenticular with horizontally aligned lenticles. The array ofhorizontal line light sources is generated by transparent slits on a LCDshutter panel which is illuminated by an array of red high-power LEDs.

The horizontal line light sources are vertically spatially coherent.Together with the horizontally aligned lenticles they facilitate thereconstruction of Fourier holograms with VPO. As the hologram-bearingLCD is amplitude-modulating, Burckhardt encoding is used. This meansthat three pixels are needed to encode one complex number. Thecorresponding pitch is therefore 3*69 μm=207 μm which leads to a size ofthe observer window of 6 mm at a distance of 2 m. The periodicityinterval of the set of observer window, undiffracted light anddepth-inverted image (1^(st), 0^(th) and −1^(st) order) is determined bythe pixel pitch of 69 μm and is 18 mm at a distance of 2 m. The observerwindow is only slightly larger than the eye pupil and therefore requirescareful tracking of the eye pupils. This is achieved by an eye finderwhich detects the position of the eyes. These data are used to controlthe vertical position and the pitch of the line light sources on the LCDshutter panel.

With the techniques described up to now each eye would see a hologram,however with the same perspective view, as the hologram is VPO.Therefore an autostereoscopic image separation is added. A verticallyaligned lenticular is placed between the hologram-bearing LCD and theobserver. Two holograms (one with left-eye and the other with right-eyeperspective view) are interlaced on the hologram-bearing LCD, e.g. theleft-eye perspective view on the even columns and the right-eyeperspective view on the odd columns. Thus the left eye only sees thereconstruction containing the left-eye perspective view and the righteye the reconstruction containing the right-eye perspective view. Theobserver is horizontally tracked by horizontally shifting the hologramcontent on the hologram-bearing LCD.

Thus all necessary information for 3D viewing is provided. The VPOhologram leads to eye accommodation and the autostereoscopic imageseparation provides the parallax information. Instead of spatialmultiplexing also temporal multiplexing is possible. However, thisrequires sufficiently fast displays which are not yet available in thedesired size and resolution.

ANNEX III

The following Annex III summarises key concepts from and enhancements toWO 2004/044659, the contents of which are incorporated by reference.

Interpretational Points:

The term computer or computing device means any device or componentcapable of computations; it covers ASICs, main CPUs, DSPs, etc.

A light source means any source of illumination, hence includes an arrayof separate light sources.

Concept A. Observer Window at the Image Plane

A display device for video holography, in which the device enables aholographic reconstruction of an object to be viewed; the deviceincluding a light source and an optical system to illuminate ahologram-bearing medium;

wherein the device is operable such that when an observer's eyes areplaced approximately at the image plane of the light source, thereconstruction can be seen.

Additional Features:

-   -   The reconstruction is the Fresnel transform of the hologram.    -   The device is operable such that a direct or inverse Fourier        transform of the hologram is generated at a viewing plane at        which the observer's eyes must be placed.    -   The holographic reconstruction can occur anywhere within a        volume defined by the hologram and a virtual observer window        formed on the image plane, through which the observer can view        the reconstruction.    -   There are separate observer windows, one for each eye.    -   An observer window is approximately 1 cm×1 cm.    -   The location of an observer's eyes are tracked and the device        can alter the position of the virtual observer windows so that        the observer can maintain a view through each observer window        even when moving his or her head.    -   The hologram bearing medium is a TFT flat screen.    -   The device is a television.    -   The device is a multimedia device.    -   The device is a gaming device.    -   The device is a medical image display device.    -   The device is a military information display device.

Concept A finds application in other contexts:

A. A method of generating a holographic reconstruction of an objectusing a display device and a computer, the device including a lightsource and an optical system to illuminate a hologram-bearing medium;comprising the steps of:

(a) using the computer to generate the hologram on the hologram-bearingmedium;

(b) arranging for the image plane of the light source to coincideapproximately with the plane of the observer's eyes to enable theobserver to view the reconstruction.

B. A data carrier programmed with data defining a video hologram, thedata on the carrier being such that it causes a display device togenerate holographic reconstructions according to the method of A above.

C. A method of distributing data defining a video hologram, the databeing distributed over a network and received at a display device; thedata being such that it causes the display device to generateholographic reconstructions according to the method of A above.

D. A computing device adapted to supply data defining a video hologramto a display device to cause that display device to generate holographicreconstructions according to the method of A above.

E. A display screen when used in a display device as defined above.

F. A holographic reconstruction generated by the device defined above.

Concept B. Large Object Reconstruction

A display device for video holography, in which the device enables aholographic reconstruction of an object to be generated; the deviceincluding a light source and an optical system to illuminate ahologram-beating medium;

wherein the size of the reconstructed object is determined by the sizeof the display and not the periodicity interval associated with thehologram-bearing medium, the periodicity interval instead determiningthe size of an observer window through which the reconstructed image canbe seen.

Additional Features:

-   -   the observer window is placed at the image plane of the light        source.    -   The device is operable such that a direct or inverse Fourier        transform of the hologram is generated at an observer plane at        which the observer's eyes must be placed.    -   The holographic reconstruction can occur anywhere within a        volume defined by the hologram and the observer window.    -   There is an observer window for each eye.    -   An observer window is approximately 1 cm×1 cm.    -   The location of an observer's eyes are tracked and the device        can alter the position of the virtual observer windows so that        the observer can maintain a view through each observer window        even when moving his or her head.    -   The hologram bearing medium is a TFT flat screen.    -   The device is a television.    -   The device is a multimedia device.    -   The device is a gaming device.    -   The device is a medical image display device.    -   The device is a military information display device.

Concept B Finds Application on Other Contexts:

A. A method of generating a holographic reconstruction of an objectusing a display device and a computer, the device including a lightsource and an optical system to illuminate a hologram-bearing medium;comprising the steps of:

(a) using the computer to generate a hologram on the hologram-bearingmedium;

(b) arranging the optical system and the hologram such that the size ofthe reconstructed object is determined by the size of the display andnot the periodicity interval associated with the hologram-bearingmedium, the periodicity interval instead determining the size of aobserver window through which the reconstructed object can be seen.

B. A data carrier programmed with data defining a video hologram, thedata on the carrier being such that it causes a display device togenerate holographic reconstructions according to the method of A above.

C. A method of distributing data defining a video hologram, the databeing distributed over a network and received at a display device; thedata being such that it causes the display device to generateholographic reconstructions according to the method of A above.

D. A computing device adapted to supply data defining a video hologramto a display device to cause that display device to generate holographicreconstructions according to the method of A above.

E. A display screen when used in a display device as defined above.

F. A holographic reconstruction generated by the device as definedabove.

Concept C. Calculating a Hologram from the Observer Window

1. A method of encoding a video hologram, comprising the steps of:

(a) selecting a point on the object to be reconstructed;

(b) defining an observer window through which the reconstructed objectwill be seen;

(c) tracing a surface from the edge of the observer window through thepoint and onto an area that forms only a portion of the hologram bearingmedium;

(d) encoding, onto the hologram-bearing medium, holographic informationneeded to reconstruct the point solely in that area.

Additional Features:

-   -   Reconstructed object comprises multiple points.    -   Encoding is such that, on reconstruction, a direct or inverse        Fourier transform of the hologram is generated at a viewing        plane at which the observer's eyes must be placed.    -   The reconstruction can occur anywhere within a volume defined by        the hologram and a virtual observer window, through which the        observer can view the reconstruction.    -   There is an observer window for each eye.    -   An observer window is approximately 1 cm×1 cm.    -   The size of the observer window is calculated as a function of        the periodicity interval of the hologram.    -   The location of an observer's eyes are tracked and the device        can alter the position of the virtual observer windows so that        the observer can maintain a view through each observer window        even when moving his or her head.    -   The hologram bearing medium is a TFT flat screen.    -   The hologram bearing medium is the display of a television.    -   The hologram bearing medium is the display of multimedia device.    -   The hologram bearing medium is the display of a gaming device.    -   The hologram bearing medium is the display of a medical image        display device.    -   The hologram bearing medium is the display of a military        information display device.

Concept C Finds Application on Other Contexts:

A. A method of generating a holographic reconstruction of an objectusing a display device and a computer, the device including a lightsource and an optical system to illuminate a hologram-bearing medium;comprising the steps of:

(a) using the computer to generate a hologram on the hologram-bearingmedium; the hologram having been encoded using the method ofCharacteristics 1;

(b) illuminating the hologram using the light source and optical systemso that the reconstructed object is visible.

B. A data carrier programmed with data defining a video hologram, thedata on the carrier having been encoded using the method defined above.

C. A method of distributing data defining a video hologram, the databeing distributed over a network and received at a display device; thedata having been encoded using the method defined above.

D. A computing device adapted to supply data defining a video hologramto a display device, the data having been encoded using the methoddefined above.

E. A display screen when used in a display device operable to displaydata having been encoded using the method defined above.

F. A holographic reconstruction generated from a hologram encoded usingthe method defined above.

Concept D. Encoding to Small Regions

A video hologram comprising a region that encodes information needed toreconstruct a single point of an object that is visible from a definedviewing position, characterised in that: [0420] the region (a) encodesinformation solely for that single point in the reconstructed image and(b) is the only region in the hologram to encode information for thatpoint, and is restricted in size to form a portion of the entirehologram, the size being such that multiple reconstructions of thatpoint caused by higher diffraction orders are not visible at the definedviewing position.

Additional Features:

-   -   Encoding is such that, on reconstruction, a direct or inverse        Fourier transform of the hologram is generated at a viewing        plane at which the observer's eyes must be placed.    -   The reconstruction can occur anywhere within a volume defined by        the hologram and a virtual observer window, through which the        observer can view the reconstruction.    -   An observer window is approximately 1 cm×1 cm.    -   There is an observer window for each eye.    -   The size of the observer window is calculated as a function of        the periodicity interval of the hologram.    -   The location of an observer's eyes are tracked and the device        can alter the position of the virtual observer windows so that        the observer can maintain a view through each observer window        even when moving his or her head.    -   Reconstructed object comprises multiple points.    -   The hologram is encoded onto a hologram-bearing medium that is a        TFT flat screen.    -   The hologram is encoded onto a display in a television.    -   The hologram is encoded onto a display in a multimedia device.    -   The hologram is encoded onto a display in a gaming device.    -   The device is a medical image display device.    -   The device is a military information display device.

Concept D Finds Application in Other Contexts:

A. A method of encoding a video hologram that can reconstruct a point ofan object, comprising the step of:

encoding into a region of the hologram information solely for thatsingle point, the region being the only region in the hologram to encodeinformation for that point, and being restricted in size to form a smallportion of the entire hologram, the size being such that multiplereconstructions of that point caused by higher diffraction orders arenot visible at a defined viewing position.

B. A data carrier programmed with data defining a video hologram, thedata on the carrier being such that it causes a display device togenerate a hologram as defined above.

C. A method of distributing data defining a video hologram, the databeing distributed over a network and received at a display device; thedata being such that it causes the display device to generate a hologramas defined above.

D. A computing device adapted to supply data defining a video hologramto a display device to cause that display device to generate a hologramas defined above.

E. A display screen when displaying a hologram as defined above.

F. A holographic reconstruction when generated from a hologram asdefined above.

G. A display device adapted to generate a holographic reconstruction,the device including a display encoded with a hologram as defined above.

Concept E. Time Sequential Encoding

A display device for computer generated holography, in which the deviceenables a holographic reconstruction of an object to be viewed; thedevice including a light source and an optical system to illuminate ahologram-bearing medium;

wherein the device is operable to time sequentially re-encode a hologramon the hologram-bearing medium for the left and then the right eye of anobserver.

Additional Features:

-   -   The reconstruction is the Fresnel transform of the hologram.    -   The device is operable such that a direct or inverse Fourier        transform of the hologram is generated at a viewing plane at        which the observer's eyes must be placed.    -   The holographic reconstruction can occur anywhere within a        volume defined by the hologram and a virtual observer window        formed on the image plane, through which the observer can view        the reconstruction.    -   There is an observer window for each eye.    -   An observer window is approximately 1 cm×1 cm.    -   The location of an observer's eyes are tracked and the device        can alter the position of the virtual observer windows so that        the observer can maintain a view through each observer window        even when moving his or her head.    -   The hologram bearing medium is a TFT flat screen.    -   The device is a television.    -   The device is a multimedia device.    -   The device is a gaming device.    -   The device is a medical image display device.    -   The device is a military information display device.

Concept E Finds Application in Other Contexts:

A. A method of generating a holographic reconstruction of an objectusing a display device and a computer, the device including a lightsource and an optical system to illuminate a hologram-bearing medium;comprising the steps of:

(a) time sequentially re-encoding a hologram on the hologram-bearingmedium for the left and then the right eye of an observer.

B. A data carrier programmed with data defining a video hologram, thedata on the carrier being such that it causes a display device togenerate holographic reconstructions according to the method defined atA above.

C. A method of distributing data defining a video hologram, the databeing distributed over a network and received at a display device; thedata being such that it causes the display device to generateholographic reconstructions according to the method defined at A above.

D. A computing device adapted to supply data defining a video hologramto a display device to cause that display device to generate holographicreconstructions according to the method defined at A above.

E. A display screen when used in a display device as defined at D above.

F. A holographic reconstruction generated by the device defined at Dabove.

1-20. (canceled)
 21. A method of generating a holographic reconstructionof an object using a display device and a computer, the display deviceincluding a light source, an optical system and a spatial lightmodulator, the optical system illuminates the spatial light modulator,the optical system images the light source into an observer plane, andthe holographic reconstruction of the object being visible by theobserver if the observer's eyes are placed at the observer plane; themethod comprising the step of: using the computer to encode a hologramon the spatial light modulator, and wherein tracking of the observer isachieved by a configurable diffractive optical element.
 22. The methodof claim 21 wherein the wavefronts are reconstructed by the hologram orwherein the wavefronts are calculated for one or more observers windows.23. The method of claim 21 wherein the hologram is computed bydetermining the wavefronts at the observer eye position that would begenerated by the object to be reconstructed.
 24. The method of claim 23wherein the determined wavefronts at the observer eye position areback-transformed to the spatial light modulator to determine how thehologram needs to be encoded to generate these wavefronts.
 25. Themethod of claim 21 wherein the computer calculates the hologram suchthat the holographic reconstruction of the object is visible by theobserver behind the spatial light modulator or in front of the spatiallight modulator or behind and in front of the spatial light modulatorwhen observed by the observer at the observer plane.
 26. The method ofclaim 21 wherein within the observer window, the wavefronts interfere ina way that leads to the reconstructed object being visible to theobserver.
 27. The method of claim 21 wherein tracking of the observer'seye position is carried out by a position detection and tracking device.28. The method of claim 1 wherein object data defining objects in thethree dimensional scene is arranged into a number of virtual sectionlayers, each layer defining a two-dimensional object data set, such thata video hologram data set can be calculated from some or all of thesetwo-dimensional object data sets; comprising the following steps: (a) ina first transformation, each two-dimensional object data set of thevirtual section layers is transformed to a two-dimensional wave fielddistribution, and the wave field distribution is calculated for avirtual observer window in a reference layer at a finite distance fromthe video hologram layer, (b) the calculated two-dimensional wave fielddistributions for the virtual observer window, for all two-dimensionalobject data sets of section layers, are added to define an aggregatedobserver window data set; (c) in a second transformation, the aggregatedobserver window data set is transformed from the reference layer to thevideo hologram layer, to generate the video hologram data set for thecomputer-generated video hologram.
 29. The method according claim 28wherein the iteration process is carried out between the distribution inthe observer window and the hologram layer, in order to compensate forerrors of the reconstructed aggregate field in the observer window. 30.The method according to claim 28 wherein the object data sets exhibitthe phase distribution or the pseudo-random phase distribution, in orderto reduce speckle noise, and enhance brightness or diffractionefficiency and brightness definition in the reference layer of thescene.
 31. The method according to claim 28 wherein all object data setsfor the section layers are assigned the same total number of discretematrix points or wherein the first transformation is performed on entiresection layers.
 32. The method according to claim 8 wherein the valuefor the distance of each object data set of the virtual section layersis chosen or is changed before transformation so that the entirereconstruction or parts of it appear in front of the hologram layer orbehind the hologram layer or in front of and behind the spatial lightmodulator when observed by the observer at the observer plane.
 33. Themethod of claim 21 adapted to reconstruct a point of the object,comprising the step of: encoding into a region of the holograminformation solely for that point of the object, the region being theonly region in the hologram to encode information for that point of theobject, and being restricted in size to form a portion of an entire ofthe hologram, the size being such that multiple reconstructions of thatpoint of the object caused by other diffraction orders are not visibleat the observer eye position.
 34. The method of claim 21 comprising thefurther steps of: (a) selecting the point on the object to bereconstructed; (b) defining the observer window through which thereconstructed object will be seen; (c) tracing a pyramid from the edgesof the observer window through the point and onto an area that formsonly a portion of a spatial light modulator; (d) encoding, onto thespatial light modulator, solely in that area which forms only a portionof a spatial light modulator, holographic information needed toreconstruct the point.
 35. The method of claim 21 comprising the furtherstep of arranging for the image plane to coincide with the plane of theobserver's eyes so that the observer can view the reconstruction. 36.The method of claim 21 comprising the steps of: (a) using the computerto generate a hologram to be encoded on the spatial light modulator; (b)arranging the optical system and the hologram such that the size of thereconstructed object is a function of the size of the display and notthe periodicity interval associated with the spatial light modulator,the periodicity interval instead determining the size of an observerwindow through which the reconstructed object can be seen.
 37. Themethod of claim 21 comprising the step of: (a) time sequentiallyre-encoding a hologram on the spatial light modulator for the left andthen the right eye of an observer.
 38. The method of claim 21 in whichencoding is such that, on reconstruction, a direct or inverse Fouriertransform of the hologram is generated at an observer plane at which theobserver's eyes must be placed or in which the reconstruction can occuranywhere within a volume defined by the hologram and a virtual observerwindow, through which the observer can view the reconstruction.
 39. Amethod of generating a holographic reconstruction of an object, themethod comprising the steps of: (a) using the computer to generate ahologram; the hologram having been encoded using the method of claim 1;(b) illuminating the hologram using the light source and optical systemso that the reconstructed object is visible.
 40. A display device forgenerating a holographic reconstruction of an object, the display deviceincluding a light source, an optical system and a spatial lightmodulator, the optical system illuminates the spatial light modulator,the optical system images the light source into an observer plane, andthe holographic reconstruction of the object being visible by theobserver if the observer's eyes are placed at the observer plane, usinga computer to encode a hologram on the spatial light modulator, andwherein tracking of the observer is achieved by a configurablediffractive optical element.
 41. The display device of claim 40 whereinthe hologram is computed by determining the wavefronts at the observereye position that would be generated by the object to be reconstructed.42. The display device of claim 40 wherein the spatial light modulatoris of a transmissive or a reflective or a transflected type or whereinthe spatial light modulator comprises a micro optical system, an electromechanical micro system or a continuously optically addressed spatiallight modulator or an acousto optic modulator.
 43. The display device ofclaim 40 wherein tracking of the observer is achieved by a scanningmirror or wherein the location of an observer's eyes are tracked and theposition of virtual observer windows is altered so that the observer canmaintain a view through each observer window even when moving his or herhead.
 44. The display device of claim 40 wherein tracking of theobserver is achieved either by mechanically or electronically shiftingthe light sources; or wherein the optical system comprises a lens,wherein tracking of the observer is achieved by shifting the lightsource relative to the lens, either by mechanically shifting the lightsource or the lens or by electronically shifting apertures on a shutterLCD panel; or wherein the optical system comprises a lens array, whereintracking of the observer is achieved by shifting light sources relativeto the lens array, either by mechanically shifting the light sources orthe lens array or by electronically shifting apertures on a shutter LCDpanel.
 45. The display device of claim 40 is switchable from a threedimensional mode to a two dimensional mode, depending on input given bythe user.
 46. The display device of claim 40 in which the hologram isencoded onto a spatial light modulator that is a TFT flat screen or inwhich the hologram is encoded onto a display in a television or onto adisplay in a multimedia device or onto a display in a gaming device oronto a display in a medical image display device or onto a display in amilitary information display device.
 47. The display device of claim 40wherein for one observer at least two observer windows are generatedeither by temporal or spatial multiplexing or wherein colour hologramsare generated either with temporal or spatial multiplexing.
 48. Thedisplay device of claim 40 wherein a full-parallax hologram or ahorizontal-parallax only hologram or a vertical-parallax only hologramis generated.
 49. The display device of claim 40 wherein the size of anobserver window is calculated as a function of a periodicity interval ofthe spatial light modulator.
 50. The display device of claim 40 whereinthe computer calculating the hologram such that the holographicreconstruction of the object is visible by the observer behind thespatial light modulator or in front of the spatial light modulator orbehind and in front of the spatial light modulator when observed by theobserver at the observer plane.
 51. A data recording medium programmedwith holographic data, the holographic data on the carrier being suchthat it causes a display device according to claim 40 to generate aholographic reconstruction of the object.
 52. A method of distributingdata defining a video hologram, the data being distributed over anetwork and received at a display device; the data being such that itcauses the display device of claim 40 to generate a holographicreconstruction of the object.
 53. A data distribution network whencarrying holographic data that can be processed by a display device ofclaim 40 to generate a holographic reconstruction of the object.
 54. Acomputing device adapted to supply data defining a video hologram to adisplay device of claim 40 to cause that display device to generate aholographic reconstruction of the object.
 55. A display device adaptedto generate a holographic reconstruction, the display device including adisplay configured to be encoded with a hologram according to claim 21.56. A holographic reconstruction from a hologram generated by the methodas defined in claim
 21. 57. A display screen when displaying a hologramgenerated by the method as defined in claim
 21. 58. A video hologramcomprising a region that encodes information needed to reconstruct asingle point of an object that is visible from a defined viewingposition, characterised in that: the region (a) encodes informationsolely for that single point in the reconstructed image and (b) is theonly region in the hologram to encode information for that point, and isrestricted in size to form a portion of the entire hologram, the sizebeing such that multiple reconstructions of that point caused by otherdiffraction orders are not visible at the defined viewing position.